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NOTE 

Tms volume includes substantially the complete Report 
presented to the Department of Economics and to the Pres- 
ident of the University in September, 1916. A few correc- 
tions and emendations have been made at the suggestion 
of members of the Department and of the President; and 
in the interests of brevity a certain amoimt of material, 
presented in full in the Report, has here been represented 
by examples only, or merely referred to. Names have, of 
course, been omitted, and in some cases the nnmbers and 
titles of courses. A few sections of the Report have been 
revised to emphasize their general bearing rather than their 
specific application or the circumstances imder which they 
were first written. The Report is published in the convic- 
tion that the problems with which it deals, the method it 
seeks to exemplify, and the conclusions it embodies are 
properly of interest to college teachers, not only of Econom- 
ics but of other subjects, not only in Harvard College but 
in other colleges. Certainly the growing desire to render 
college curricula and college teaching more efifective for 
educational ends justifies the presentation of any sincere at- 
tempt to deal comprehensively and in a scientific spirit with 
the teaching of an important college subject. 



PREFACE 

The inspection of which this Report makes record is ap- 
parently without precedent. There have been investiga- 
tions of certain aspects of college teaching, and studies of 
various phases of college administration, and there have 
been collections of tests and standards for college instruc- 
tion; but never before, within the knowledge of those who 
undertook this task, has one college department tiuned to 
another, even to the department professionally concemed 
with the problems of teaching, with the invitation to study 
its courses with all possible thoroughness, without limitation 
of time or other condition whatsoever, and with assurance 
of cordial welcome, support, and assistance. 

The invitation bespoke the faet, of which the whole In- 
spection has given further evidence, that the Department 
of Economics feels a vital concem in problems of teaching, 
quite apart from its concem in Economics as a subject; and 
it implied the belief that teaching may be approached in a 
scientific attitude of mind and improved as a result of scien- 
tific study. In other words, the invitation bore witness to 
the presence and persistence in college instruction, and 
specifically in the teaching of Economics, of pedagogical 
problems not easy to solve either in the light of personal 
opinion or of unorganized and imcriticized experience. 

An inspection by coUeagues whose whole interest centers 
in such problems was a reasonable proposal, which it was 
almost impossible not to accept. Although the Division of 
Education could not whoUy foresee how much of the work 
would have to be done under distractions at times almost 
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viii PREFACE 

fatal to sustained efifort, it recognized fully the magnitude 
of the undertaking and saw in it an exceptional opportunity 
for the objective study of educational problems in the col- 
lege. The Division therefore applied itself to the task with 
f nll consciousness of its possibilities and its importance. We 
have tried to face fundamental questions, however difficult, 
as they appeared, and to deal with them broadly. Although 
we have kept close to the facts secured in the conrse of the 
Inspection, we have not sought to escape from consideration 
of situations and issues with which all college teachers are 
concemed. 

We beg to express to the members of the Economics De- 
partment our appreciation of their interest and assistance. 
Professor Bullock, as Chairman of the Department, and 
Professor Day, because of his connection with the large in- 
troductory course, have been most burdened with our re- 
quests for information and help, and we are especially in- 
debted to them for their constant and ungrudging co- 
operation. 

The Inspection has been the work of all the present mem- 
bers of the Division of Education, as well as two former 
members: Dr. F. W. Ballou, now Assistant Superintendent 
of Schools in Boston, and Mr. D. H. Fletcher, '99, now 
Headmaster of the Detroit University School. Without 
the highly competent assistance of Dr. Alfred Johnson, '98, 
the large tables sxmmiarizing the questionnaires could not 
have been completed, and the subsequent discussion of them 
owes much to Mr. Roy Kelly, A.M., '16. In the production 
and interpretation of charts and tables we have had valuable 
help from Mr. E. A. Shaw, A.M., '16, Mr. L. G. Burgevin, 
'15, Miss Eleanor Abbott, Mr. L. P. Damon, A.M., ^16, Mr. 
E. A. Lincoln, '13, Mr. R. P. Currier, '12, Mr. C. R. Small, 
'09, and Mr. H. A Sturgis. 

The Division of Education presents this Report to the 
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Department of Economics and to the President of the Uni- 
versity without expectation — as perhaps need hardly be 
remarked — that it will ofifer final solutions for the many 
and important problems which present themselves m the 
teaching of Economics at Harvard. We have made every 
eflfort, however, to provide an adequate basis of faet for the 
study of those questions we felt competent to consider, and 
to discuss them comprehensively. It goes without saying 
that we shall take the most genuine interest in further dis- 
cussions or inquiries conceming any of the facts or conclu- 
sions presented in this Report. 

Paul H. Hanus, 
George E. Johnson, 
Ernest C. Moore, 
Walter F. Dearborn, 
Alexander J. Inglis, 
John M. Brewer, 
Henry W. Holmes, 

Chairmanm 
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CHAPTER I 

THE mSPECTION AS A WHOLE 

I. CONDUCT OF THE InSPECTION 

The invitation to undertake the Inspection was presented 
and accepted in October, 191 2, but no work of importance 
could be undertaken until 1913, owing to temporary ab- 
sences of members of the Division of Education during the 
first half of that academic year. During the second half of 
the year plans for the Inspection were completed and dis- 
cussed with members of the Department of Economics and 
with President Lowell. Two of the studies presented in this 
Report were begun, and two others attempted which proved 
impossible to carry out. Chapter VII of this Report, on Mark- 
ing, and Sections I, II, III, and IV of Chapter IV, on Minor 
Quantitative Studies, are based on the work done in the 
spring of 1913. On Qctober 29, 1913, a conference between 
the Department of Economics and the Division of Educa- 
tion was held in Dåne Hall, at which were presented a pre- 
liminary report on the studies begun the previous spring and 
the completed and revised plans for the Inspection. The 
work of the academic year 1913-14 consisted of an inquiry 
conceming the study habits of imdergraduates, reported in 
Section II of Chapter IV; an analysis of statements of aim 
by the instructors in Economics, reported in Chapter II; 
the transcription on to special cards of 3863 college records 
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4 THE-XmCHING OF ECONOMICS 

of students (Qlasges 1903-13) who had taken a course or 
courses in.EéQhomics; and the preparation of most of the 
charts aii<i;teWes used in Chapter III. The visits to class- 
roontlbegan in the spring of 1914 and continued during the 
succQeding academic year, 1914-15. The other work of 
;tKått*year was the preparation of the questionnaires, which 
. Vv^^^^ ^^^' ^^' ^ February and March, 1915. The academic 
year 1915-16 was spent in coUating the data suppUed 
by the retnms to the questionnaires and in writing the 
Report. 

At every stage of the Inspection we have found it pro- 
foundly interesting; but the distractions against which we 
often had to contend have lessened the satisfaction we 
should otherwise have taken in it, and in some cases have 
prevented us from completing particular studies and ex- 
periments, as the Report will indicate. If a similar investi- 
gation is ever carried on imder University auspices we would 
eamestly reconmiend that one man, designated by the de- 
partment or committee in charge of the investigation, be 
given full authority and freed from all other duties for at 
least a year. He ought to have clerical assistance and the 
cooperation of competent graduate students, as well as 
opportunity to conf er with the other members of the depart- 
ment or the committee conducting the investigation. The 
whole department or committee should be responsible for 
the methods and conclusions; but at least one person should 
be enabled to give to the investigation his undivided at- 
tention. 

II. AlMS 

With complete f reedom to conduct the Inspection accord- 
ing to our own plans, we formulated at the outset several 
general prindples which we considered, and now record, as 
soimd — indeed necessary — for the guidance of such an 
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undertaking. We held, first of all, that oiir standpoint 
throughout should be strictly educational, and hence that 
we had no immediate concem with the highly important 
work of the Department or of its individual members in 
advandng Economics as a science or in serving the public, 
philanthropic institutions, or the business world — except, 
of course, as such service reacts on teaching. Our inquiry 
therefore kept constantly in view the only educational end 
in itself there is — the individual student; and our primary 
concem was with the imdergraduate. Conceming the eflfects 
of instruction in Economics on the character, the com- 
petence, and the career of the student, of whatever class, we 
desired to secure the fullest information possible; and our 
second prindple was that this information should constantly 
be sought in the form of verifiable and pref erably quantita- 
tive records, so that our conclusions and reconmiendations 
might have a firm basis of faet. We did not suppose that 
all our studies could be statistical, for the data of education 
cannot alwajrs be treated statistically with the greatest 
profit; but we wished to avoid, so far as possible, either mere 
opinion based on personal observation which cannot be 
confirmed, or appeal to general prindples which are still 
subject to discussion. As a coroUary to this, we held that 
the Inspection should be wholly impersonal. We did not 
fed cailed on to criticize the teaching of individual instruc- 
tors, not only because the task would have been imgrateful 
to us, but for the more technical reasons stated in the first 
section of the chapter on Method. Questions of method, 
important as they are, are not as significant in education as 
is sometimes supposed; aims are more important, and the 
general organization of means and materials also. Method 
lies rather within the art of education than within the science 
of it, and must be acquired by practice and continued super- 
vision. We f dt, therefore, that our results and recommenda- 
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tions ought to be general and that data as to particular 
courses ought, if they came to us, to be tumed over to the 
Department simply for what they might be worth. 

We decided, also, not to hesitate to deal with any prob- 
lem m its most general form, provided our data justified us 
m dealing with it so. Thus the chapters on Aims, on Meth- 
ods, and on Marking all contam some discussion bearing not 
only on the teaching of Economics but on much college 
teaching in other subjects. We have tried always to keep 
to our basis of faet, if not in the form of quantitative sum- 
maries, at least in the form of analyses of actual records; 
but we have not narrowed the discussion to the teaching of 
Economics when no distinction could properiy be made be- 
tween the teaching of that subject and the teaching of others. 

Many specific recommendations we did not expect to 
make. An educational poUcy must be determined by those 
who have the entire body of facts in mind, and one important 
class of facts we were not, and could not be, in a position 
f ully to master — the facts, namely, of Economics as a sub- 
ject. Aims and methods in the teaching of any subject must 
be conceived in the Ught of socially and individually desir- 
able results in the Uves of the students, and in the light of 
the opportunities oflfered and the limitations imposed by 
conditions, including the characteristics of the students 
themselves, their stage of advancement, and their own pur- 
poses, and including also the values inherent in the subject 
as an educational instrument. These last we know only as 
la3anen know them: and our conclusions and recommenda- 
tions are accordingly tentative, with whatever finality they 
may be expressed. They are subject to revision in the Ught 
of expert knowledge of Economics, being valid in their pres- 
ent form only so far as reasoning competent to the general 
educator can establish them. 
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III. WoRKiNG Plan 

The Plan approved at the conference of October 29, 1913, 
was very useful, as a basis, throughout the Inspection, but 
it was avowedly provisional and we had to depart from it in a 
nnmber of points as the work progressed. Its arrangement 
shows, however, onr general conception of the task, and its 
headings are therefore reproduced below. The Report does 
not follow the headings of the Plan because the material as 
it came in proved even more extensive than we anticipated 
and because it took shape more conveniently under other 
headings. The Report contains data or discussion, how- 
ever, on all the questions formulated in the Plan. 

Preliminary list of questions for use in the Economics 
Inspection^ October 2p, igij 

A. Curricula and Student Achievement 

1. What curricula do students pursue? 

(a) Economics A only 

(b) Economics A and Middle Group courses, etc. 

2. What grades do students eam in the several courses? 

3. What growth do students show in ability to deal with eco- 
nomic problems? 

This point cailed for the construction of a "fimdamental 
test." (See below, Ch. 4, § IV) 

B. Factors in the Choice of Curricula and in Student Achievement 

I. Selection of Courses. 

1. What are the students' aims? 

2. What guidance does the Department give them? 

n. Grades. 

1. What is the Department's standard of grading? 

2. What is the relation between the students' ages and 
their class in college and the grades they eam in this 
Department? 

3. What is the correlation of grades in Economics and 
grades in History? Government? Other subjects? 
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in. Methods. 

1. What are the advantages of inductive presentation in 
the teadung of Economics? 

2. What are the advantages and possibilities of laboratory 
and field work of a constructive kind? 

3. What are the possibilities of direct control by instructors 
of the study devoted to material to be memorized by 
students? 

IV. Aims. 

1. What aims have the members of the Department now 
in view for undergraduate instruction in Economics? 

2. What are the spedal aims of the instructors in their 
several courses? 

Two important parts of the Plan we could not carry be- 
yond their initial stages — the construction and use of a 
"fundamental test" for the measurement of growth in gen- 
eral ability to deal with economic problems, and the conduct 
of controUed experiments in method. Our proposals in both 
cases are discussed in Chapter IV. In neither case was the 
difficulty inhérent in the nature of the imdertaking. With 
the cooperation of Professor Day we made good beginnings 
in both. But it was impossible to continue, because nobody 
concemed could give these tasks the necessary time. Al- 
though we had hoped to deal first, by test and experiment, 
with student achievement in Economics, and later, in view 
of the results obtained, inquire into aims, methods, and 
marking, we foimd it imperative to go ahead with the sta- 
tistical studies, the analysis of statements of aim, visits to 
classes, and the questionnaires to students. Under other cir- 
cmnstances, however, the difficulties we encoimtered could 
be f ully obviated by relieving investigators and staff of other 
burdensin favorof this work. Westill believein thepossibility 
and in the value of controlled experiment in college teaching 
and of the attempt to measure its results — at least in some 
subjects — by means of a fimdamental test. A fimda- 
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mental test, as is elsewhere pointed out, cannot take the 
place of a course examination; but as a means of educational 
investigation it is worth taking miich pains to devise and 
apply. Experiments yielding quantitative retums can be 
carried on without material injustice to the students in- 
volved and with great promise of benefit to their successors. 
Without these means of securing information about our 
work, we must still rely on data far less convincing, such as 
replies to questionnaires, or else on conjecture, opinion, and 
uncorroborated conclusions from experience. 

IV. Suggestions for Further Study 

One of the supplements to this Report consists of a list of 
questions and problems which was formulated early in the 
course of the Inspection and from which the Plan just dis- 
cussed was derived. Most of the inquiries proposed in the 
list have been made, in one way or another; but in two of the 
main fieids of inquiry there defined — as to the Staff and as 
to Costs — we did not f eel prepared to secure the necessary 
data, and in some others our data must be supplemented 
before soimd conclusions can be established. We would 
therefore suggest to the Department further studies imder 
the headings given in this section, below. Other suggestions 
for study are contained here and there in the Report, in 
addition to general recommendations of poUcy or procedure. 
We would also recommend that the Department conduct 
experiments and inquiries to complete those reported 
(whether as merely attempted or as partly carried out) in 
Chapter IV — the experiments in Method and the project 
of a Fimdamental Test; and further, that in Economics A 
and if possible in other courses, studies of marking be made 
similar to the one reported in Chapter VII. It would be 
worth while, besides, to follow up the questionnaire to stu- 
dents with specific inquiries to selected men, especially as to 
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the vocational use to which they have since been able to put 
their knowledge of Economics. 
The fieids in which we would suggest new studies are : 

1. The scope, organization, and departmental regulation of the in- 
struction, both in Economics as a whole and in its several 
branches. 

A study of the courses given in other universities woidd be 
a natural startmg point for inquiry under this head. The 
inquiry ought to be broad enough to include the problem of 
the relation between Economics and Sociology and between 
Economics and Social Ethics. Important special studies 
might be made of the fieids covered by the several courses — 
their relationships to each other and to various forms of ac- 
tivity outside of college. The suggestion, made by the De- 
partment CoDMnittee on Courses of Instruction, that a 
imiform system of keeping lecture notes be adopted, might 
well be considered further, and broadened to cover the 
system of assigning reading and thesis subjects, recording 
written work, and providing source material and opportuni- 
ties for field work. The practicability of crediting in certain 
courses active work during the siunmer months — inves- 
tigations, apprenticeship in banks, corporations, or railroads, 
govemment service, or service in philanthropic institutions 
— deserves caref ul study. Might not a solid piece of field 
work in the summer af ter the Jimior year be reasoi^ably ac- 
cepted in place of the spedal Divisional examination, or of 
part of it? 

Comparison might profitably be made between the De- 
partment of Economics and other departments in the Col- 
lege: as to the nimiber of courses offered, the instructors em- 
ployed, the students taught, concentrations and degrees with 
distinction, doctorate examinations, standards of grading. 

2. The staff — distribution of work among the members of the De- 
partment; the time spent in writing and research, committee 
work, public service, and teaching outside the College; dis- 
tribution of graduate and undergraduate teaching; criteria for 
judging the effidency of instruction; practicable methods of 
inspection. 

3. Costs — equipment and resources; teaching; publications. 

A study of costs would involve a study of the size of dasses 
and the per pupil expenditure for various courses, espedally 
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for undergraduate instruction as compared with graduate 
instruction. 
4. Causes of failure and poor work, especially in advanced courses. 
A full study of the cases of D and E men, especially 
of their success in other coiirses and in af ter life, might lead 
to interesting conclusions conceming the possibiUty of meet- 
ing individual needs in college teaching and especially con- 
ceming the opportimities for advice and guidance in the 
choice of courses in college and of vocations afterward. 
Causes of success in college work might be studied in similar 
fashion. 

V. General Impressions from the Inspection 

The Inspection was nndertaken without prepossessions, 
and this Report has not been written to support any pre- 
conceived educational policy; nor does it contain any section 
advancing detailed proposals for "reform." For reasons 
already given, we must present our conclusions and sugges- 
tions with the expectation that they may be modified or 
reversed by those who have intimate knowledge, outside 
the scope of our inquiry, of an important aspect of these 
problems. Yet a few outstanding features of the whole body 
of data we have studied may be characterized in general 
terms with some hope of profit. They are veins, meta- 
phorically speaking, which run through the statistics, lists, 
and analyses of the Report. In some piaces they are less 
prominent than in others, but to one who has dissected the 
whole mass they stand out with imdeniable cleamess. 

These features are imdoubtedly as characteristic of college 
instruction in general as of instruction in Economics. They 
imply tendencies in college teaching which spring from the 
situation in which the college teacher finds himself . In part 
they are due to tradition, in part to more concrete causes, 
such as lack of fimds, in part to difficulties inherent in 
teaching men of college age. 

College teaching tends to present aU subjects from a 
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scientific point of view : it is likely to be academic — and 
the teaching of Economics escapes neither the advantages 
nor the disadvantages of this tendency. It exponnds to 
inexperienced yoiing men theories and masses of informa- 
tion before they have become acquainted in any personal 
way with the elementary facts, processes, and situations 
with which the subject deals. It requires a great deal of 
listening and reading, and very little observation, practical 
judgment, or active decision. Its issues are not significant 
at the moment: they induce effort to make them clear only 
for the immediate purpose of passing examinations or pre- 
senting good theses. The teaching brings students into 
touch with the activities of the world too seldom or too 
partially to permit them to relate what they are studying 
to what men are doing. Students find it hard not to make 
college study a game, in which they may legitimately apply 
themselves to getting marks by studying books, examina- 
tions, and their professors, at the expense of a vital knowl- 
edge of the subject. Progress here certainly does not lie in 
the abandonment of marks, lectures, reading, section meet- 
ings, and the rest of our common machinery, but in the 
persistent efiEort to sharpen issues, awaken thought, and 
induce vigorous mental reaction by every means at our dis- 
posal, especiaUy by utilizing every opportimity to bring 
students face to face with the subject as an aspect of life in 
the concrete. 

College teaching, at least in America, tends to be dis- 
connected: it is conducted by imits which are not natural 
divisions of interest and activity in life, but are fenced off 
from one another for pedagogical purposes. This tendency 
the Division of History, Government, and Economics is 
already vigorously combating through its recent adoption 
of Divisional examinations and Tutorial instruction. But 
even the new scheme runs the risk of remaining artificial if 
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the Schedules it involves are made without clear reference 
to the purposes of the students who elect to f ollow them — 
without reference, that is, to the legitimate outcome of any 
Schedule in practical activity or further study. Specializa- 
tion in college ought to have some point. If the old 
elective system made the mistake of permitting college 
boys to patch their curricula together as whim or conven- 
ience might dictate, the new system may fall into the error 
of assuming or f orcing in every student a scholarly bent or 
interest which he does not possess and cannot develop. 
College teaching ought to be cathoUc enough to admit 
among the considerations on which specialization may be 
based such practical purposes as intention to enter diplo- 
matic service, medicine,military service, joumalism, business, 
or any other career. What preparation, immediate or remote, 
any given course afiEords for any given occupation is a matter 
for investigation or for special adjustment of the course; but 
it is injurious to insist that concentration shall be deter- 
mined solely by the artificial distinctions between subjects 
and fieids for distinction, while the ambitions of students 
and the practical possibilities of curricula are ignored. 

College teaching tempts instructors to slight the laborious 
detail of instruction — the minutiae of method, marking, 
and the administration of requirements, the tediousness of 
conferences, thesis reading, and the checking of results. The 
teaching of Economics probably suffers less from this tend- 
ency than the teaching of many other subjects; and our data 
suggest a general danger rather than a specific defect. The 
poUcy of departmental control and reasonable supervision 
already adopted by the Department is nevertheless clearly 
advisable; and both study and experiment with devices, 
methods, and poUcies are as clearly necessary to the estab- 
lishment of more effective systems and standards in the 
teaching of imdergraduates. 
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College teaching tends to miss the individual — to break 
the contact between teacher and pupil which makes school 
work efiEective in certain respects, as it often endangers its 
efiEectiveness in others. More money is the final solution of 
this problem, for more money means more teachers; but a 
better adjustment of the demands on mdividual instructors 
for teaching, administrative and conmiittee work, and writ- 
ing, is also needed. The policy of expecting every college 
teacher to produce has been beneficial to many instructors 
and harmful to many students. Personal contact is the 
heart of education, and time spent in it ought never to bur- 
den a college teacher's conscience as time wasted. Advice 
as to courses, curricula, future vocations, reading, general 
conduct; discussion of problems and questions in a course 
or a subject; conferences on theses, papers, and examination 
books, both as to content and as to form and style — these 
ought to be as free to students from college teachers of every 
rank as the resources of the college can render possible. It 
is clear that the Department of Economics makes due efiEort 
to fulfill its obligations in this phase of teaching, and the 
Tutorial plan will doubtless prove especially valuable in this 
very respect: but the general limitation imder which all 
college instruction suflFers because there is not time for pro- 
fessors to know their students as individuals, appears in this 
investigation as it imquestionably would in any other, and 
for this particular problem the Tutorial scheme cannot, in 
the nature of the case, oflFer a final solution. 

Looming larger and more impressive throughout the 
Inspection appeared the conclusion that college teaching 
too often faUs to reach the student. Obstacles and distrac- 
tions of many sorts prevent educative contact between 
teacher and pupil. The fimdamental problem in the College 
is the problem of individual instruction, or, if we may use a 
phrase so general as to cover the whole life of the imder- 
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gradnate, the problem of individual development during 
the college yeaxs. We find no reason to despair of the college 
or to favor a reorganization on the Junior-College plan; nor 
do we find reason to believe it unpossible to solve this prob- 
lem m the large, urban, imiversity college. We see no single, 
simple road to a solution, but we believe that a combination 
of many measures, carefully related and sensibly admin- 
istered, may bring us as near as is himianly possible to fuU 
success in imdergraduate education. Two conditions, we 
are confident, are essential to any plans or efiEorts toward 
this end — a general willingness on the part of college teach- 
ers to study the problems of instruction, training, and disci- 
pline as carefully, as broadly, as intensively, and as objec- 
tively as they would study the problems of the subject they 
teach; and an organization of college work which will make 
it unnecessary for any teacher to be so overburdened by the 
nimiber of his students, the variety of the sub jects he teaches, 
administrative duties, the claims of research, or the need to 
do remimerative outside work, that he must neglect the 
individuals imder his charge. 



CHAPTER II 

AIMS 

I. Statements prom Members op the Department 

OF ECONOMICS 

On August 4, 19 13, the following circular letter was sent to 
members of the Department of Economics: 

As a part of oiir survey of the work of the Department of Eco- 
nomics we are askmg each instructor m Economics to formulate for 
us the aims of the conrses that he gives; that is to say, we woidd like 
a brief but comprehensive statement of what each instructor expects 
the students to get from each of his courses. Doubtless each in- 
structor has a general aim, which is in harmony with the pxirpose of 
any instruction in Economics or is identical with it; but in addition 
each course also naturally represents the instructor's endeavor to 
realize a particular portion of the general aim or to cover some par- 
ticular aspect of it. In any case, we would like to know what the in- 
structor's pxirposes are. Will you kindly let us hear from you soon? 

Replies to this request were received from eight instruc- 
tors, and included specific statements conceming eighteen 
courses. The letters themselves may be secured by anyone 
especiaUy interested to read them. They are not printed 
in this voliune, in part because they were sent as personal 
letters without a view to publication, in part because their 
general tenor is presented and analyzed in the following 
discussion in sufficient detail to make the printing of the 
letters themselves imnecessary. Also, the replies are sum- 
marized in note i, Section V, Chapter IV. The present 
chapter gives the results of an analysis, comparison, and 
general discussion of these statements of aim. 

z6 
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The Division of Education was of course competent to 
consider only the educational aspects of the statements 
submitted, without the least assumption of insight as to the 
bearing of particular courses on progress in Economics or 
on social issues or individual needs. The replies were so 
evidently careful, and so clear and comprehensive, that for 
this purpose no further inquiiy seemed necessary. 

II. The Place or Aims in College Teaching 

Some of the letters state or imply that the instructor had 
not previously given definite form to the aims of his courses; 
but this faet did not result in any imcertainty of statement, 
for the reason, as it would seem, that the aims thus formu- 
lated were drawn from the actual practice of the instructors. 
They appear, in other words, to be statements of direction 
in the instructors' work, rather than of ideal ends, defined in 
the light of general educational considerations. These re- 
plies (and, it may be added, the drift of testimony from the 
questionnaires and the visits) provide no evidence, therefore, 
of a consistent and clearly enimciated educational policy, 
in the light of which the aims of particular courses may be 
stated. This is imdoubtedly a condition characteristic of 
college instruction in almost every field. 

The common and heretofore possibly the wholesome 
tendency of American college instructors is to attack their 
courses first from the standpoint of the subject, and only 
later consciously to adjust them for use strictly as educa- 
tional instnunents. No teaching, however, can be com- 
pletely and permanently successful, as teaching, without the 
recognition of definite educational objectives; and this faet 
suggests the importance of formulating aims, and of the 
discussion of aims in department meetings. Certain diver- 
sities in these very statements are probably due in part to 
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the faet that discussion of educational aims and values is 
still so nnusual in departmental and f aculty meetings that 
there is among college teachers no clear agreement as to the 
terms, general conceptions, or particular categories m which 
such discussion can best proceed. In so far as this is true, 
it suggests the value of making the discussion of such state- 
ments as these the order of business for a series of depart- 
mental conferences. 

This suggestion is exactly in line with the noteworthy 
advance made by' the Department of Economics in its votes 
separating graduate and undergraduate instruction and plac- 
ing the latter imder departmental control. The recent regu- 
lations conceming a general examination for students who 
concentrate m the Division of ffistory, Government, and 
Economics look in the same direction — toward imity of 
educational eflfort. If imdergraduate teaching is to be made 
generally efiEective, college instructors must submit to some 
limitation of individual f reedom — a limitation which need 
not be autocratic, indeed cannot become autocratic, so long 
as it is efifected by open discussion. In Harvard College, 
the control of imdergraduate courses through the submis- 
sion, for departmental discussion, of outlines covering aims, 
general methods, and requirements of reading, theses, and 
other work, is a policy as desirable as it is imusual. The 
visiting of classes by departmental conmiittees chosen for 
the purpose may also be made of incalculable value to in- 
structors. No instructor genuinely interested in the edu- 
cational efiEects of his work will object to submitting his 
plans, in detail, to a department meeting, nor to subsequent 
visits by his colleagues and frank discussion of the entire 
conduct of his work. 
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III. Analysis or Statements by Members or the 

Department 

The aims here under consideration may be analyzed and 
grouped as follows: In courses which cover many facts and 
principles variously interrelated, the goveming aim is usu- 
ally the presentation of a systematic survey of the field. This 
presentation is of ten determined by a point of view which 
the students are expected to acquire even if they f orget much 
of the detail of the lectures and reading. In such courses 
there is also general agreement on training in assembling 
facts, analyzing them, and reasoning from them (e. g., Eco- 
nomics A, 4a, 4b, 6a, 2a, 2b, 3, i, 5, 14, 31).^ Courses in 
which a general conception is dominant find their chief pur- 
pose in the analysis and clarification of this conception and 
in training the students to apply it to concrete cases (e. g., 
Economics 8, 7, 9). Certain courses involve training in a 
technical method of dealing with facts (Economics i, 9). 
Minor but important aims are given in certain cases: e. g., to 
familiarize students with the Uterature of the subject (Eco- 
nomics II, I, 14, 31); to present selected problems and to 
provide training in scientific methods of dealing with them 
(Economics 33, 5, 14, 31, 2oe); to train in careful and critical 
reading (Economics 14, 31). The stimulation of public 
spirit is stated as a definite aim in Economics A, 4a, 6a, and 
3. General moral discipline through work is given as an aim 

^ The pamphlet in which these courses are described will be sent on request by 
the Publication Office of the University, 2 University Hall, Cambridge, Mass. 
As the numbers attached to courses are sometimes changed from year to year, it 
is necessary to note that the numbers here given refer to courses oflfered in 1913-14. 
The general argmnent of the chapter is not affected, however, by such minor 
changes as have since been made, and all but a very few of the numbers used 
designate the same courses now (191 7) as in 1913-14. The only substantial change 
in courses since 19 13-14 consists in the withdrawal of Economics 9, the course in 
AccoufUing, and the substitution therefor of a half-course in Accounting, numbered 
la and designed specifically for undergraduates. Course i , in StatisticSf becomes ib. 



20 THE TEACBING OF ECONOMICS 

in Economics 4a, 4b, 6a, i, and 3. To improve the written 
English of graduate students is given as an aim in Economics 
2oe. 

This analysis yields the following somewhat loose correla- 
tion of aims: 

1. To survey the subject for a comprehensive and systematic view 
of the field to be covered. 

(a) To familiarize the students with the literature of the 
subject. 

(b) To present with special care selected illustrative problems. 

(c) To give the students insight into modem economic con- 
ditions and problems. 

2. To train the students in methods of study and thought appro- 
priate to the subject. 

(a) To train the students to deal scientifically with concrete 
problems of a special sort. 

(b) To train the students in a technical method which the 
subject involves. 

{c) To train the students in the careful reading of selected 

books. 
{d) To analyze a general conception and induce clear think- 

ing in terms of that conception. 

3. To stimidate pubhc spirit. 

4. To give general moral disdpline through work. 

This grouping may do violence to some of the aims as 
stated, and it is at best but an arrangement suggested by the 
statements, not contained in them; yet it is probably fairly 
representative of their main trends. The first group of aims 
centers in the idea of presenting the facts and principles in 
the field covered by the courses; the second, in the idea of 
training the students to deal effectively with those facts and 
principles. These two groups are correlative, and together 
they cover by far the greater number of the stated purposes 
of the courses. The third aim is mentioned or implied sev- 
eral times, but apparently as an aim to be realized through 
the general conduct of the courses rather than as a dominat- 
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ing purpose for which the material of the courses is organized 
and the methods chosen. The fourth aim is an aim com- 
mon to all good college instruction. Both the third and the 
fourth aims depend for their realization, in any case, less 
on choice of materials and methods than on the personal 
attitude and influence of the instructor — on his power to 
inspire, enlighten, and guide; on his insistence on standards, 
fairness in marking, and ability to meet individual needs in 
assigning work; and on similar capacities and habits of 
teaching. 

It may fairly be said that the statements, as a group, 
show a tendency to derive the purposes of instruction from 
the material of the courses. That is, they convey the im- 
pression that the work is organized primarily to cover the 
field, never, to be sure, without reference to the uses of 
knowledge, insight, and technical skill, but without ruling 
interest in the situations and relationships in which the 
student will find himself outside of college. The faet that 
the student is to be an active participant in economic life 
is not ignored; but the main picture of the student sug- 
gested by the statements is a picture of one whose need is 
first of all for systematic or scientific knowledge. There is 
no lack of reference to the student, nor to the qualifications 
he must have to be successful in the work of the courses. 
There is less reference to the question, What will he use his 
achievement in the courses for? 

This condition might suggest a superficial arraignment 
of instruction in Economics as "academic," "lacking in 
practical application," or "imduly scientific." Many of the 
replies to the questionnaires, both graduate and imder- 
graduate, would support some such treatment of the mat- 
ter; but it would obviously be an easy dismissal of what is 
in faet a f imdamental problem in college teaching. 



22 THE TEACHING OF ECONOMICS 

rv. General Discussion 

The problem concems not single courses only, but the 
whole curriculum of the student in the given field. This 
is the more apparent now that the Faculty has adopted the 
principles of concentration and distribution; and in the 
Division of History, Government, and Economics, since it 
has established the Divisional examination, the general 
nature of the problem cannot but be evident. The question 
is, From what point of view shall those comprehensive aims 
be stated which are to govem the conduct of the total offer- 
ing of imdergraduate instruction in Economics? Aims in 
smgle courses depend on the larger purposes for which 
courses are organized into Schedules for concentration, dis- 
tribution, distinction, and, in the end, the baccalaureate 
degree. Per contray the making of such "concentration 
Schedules" as have recently been issued by the Division of 
History, Government, and Economics calls for very careful 
scrutiny of the aims of the courses contained in them. The 
problem centers, therefore, about the use of Economics for 
imdergraduate specialization. 

The statements here imder discussion present no dominant 
standpoint and refer to no common purpose of instruction. 
Vocational application is in at least one statement (Econom- 
ics 9) the determining consideration, as in that case it is 
obviously appropriate that it should be; in other cases (e. g., 
Economics 4a, 4b, 6a) vocational application enters to a 
certain degree as a factor in the formulation of the aim: 
but it cannot be said that the courses in Economics, as a 
whole, are directed toward vocations. They are not intended 
to be courses in Business Administration, and preparation 
for special careers is evidently not considered to be their 
fimction. But there is no clear indication, either, that 
preparation for participation in political, philanthropic, and 
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govemmental activity is the dominant aim. The state- 
ment for Economics 4a, 4b, and 6a alone distinguishes ex- 
plicitly between citizenship and vocation as objectives; 
although other statements (Economics 3, 7, 8, 31) mention 
or suggest the broader social use of knowledge as a determin- 
ing factor in the formulation of the aim. 

The commonest implication of the statements is that a 
general imderstanding of economic conditions and economic 
forces is the ultimate end to be achieved; and there are, 
of course, clear groimds for the def ense of so inclusive (even 
if so indefinite) an aim. It may be said that every college 
graduate ought to comprehend the economic order in which 
he must live and work; that the imdergraduate study of 
special aspects of Economics ought to be directed primarily 
toward the deepening and imifying of that comprehension; 
and that every imdergraduate course ought therefore to be 
fimdamentally a course in the principles of Economics. In 
similar fashion, it should then be argued, every undergrad- 
uate course in science ought to deepen and imify the general 
imderstanding of the natural order, and in that sense be a 
course in the principles of science; every course in history 
reveal with added fullness the general evolution of human 
afiFairs; every course in literature lead to a clearer insight into 
the nature of Letters ; and so on. If this standpoint is in faet 
accepted in any given field, it connotes acceptance of a view 
of college education which has recently found more and 
more frequent expression — the conception, namely, that 
the final outcome of a college education should be an articu- 
late philosophy or interpretation of life, or an approach 
to it, or at least a definite advantage in the attempt to 
achieve it. 

If undergraduate instruction is to be purely cultural, 
some such definition of culture is essential as a basis for in- 
struction and the administration of college curricula. Good 
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taste cannot be accepted as an adequate criterion of culture, 
nor the ability to fill one's leisure with refined enjoyment. 
The modem conception of culture implies insight as well, 
and the organization of knowledge, interests, and capacities 
for an intelligent reaction to the demands and opportimities 
of lif e in a civilized commimity. Although culture must be 
distinguished from usefulness, it is in itself supremely useful; 
but it is general, and depends on the development of no 
speciaUzed capadty, no single power, no limited body of 
knowledge. 

It was possible once to hold that intimate acquaintance 
with the Classics could alone enable one to "see life stead- 
ily and see it whole"; but the Classics no longer compre- 
hend even the himianities, to say nothing of the sciences. 
The doctrine, subsequently advanced, that formal or gen- 
eral intellectual discipline, obtained from a single subject or 
in a single fidd, or from a restricted curriculimi, is a possible 
or practicable result of a college education, has been sharply 
questioned, and at least in its cruder forms, disproved. 
(The statements of aim in Economics, it may be noted, are 
very nearly free from the suggestion that the student may 
obtain a discipline of mind in that subject such as to enable 
him to deal easily and adequately with every other impor- 
tant aspect of experience.) Indeed, no single study or nar- 
row group of studies is now considered sufficient to provide a 
culture comprehensive enough to result in a penetrating and 
well-balanced view of the modem world and the life of man. 
On the contrary, the dictiun most of ten quoted is that cul- 
ture demands "something of everything and everything of 
something," to the end that the college graduate may in- 
terpret life at once broadly and without superficiality. 

This prindple is imdoubtedly much soimder than the 
principle of formal discipline, and, sensibly applied, it may 
effect (and in faet has already effected) very desirable re- 



AIMS 25 

fonns in the administration of the elective system. It does 
not of itself , however, coimteract a somewhat marked tend- 
ency in our instruction which is generally admitted to be 
undesirable — the tendency to deal with undergraduate 
subjects from the point of view of the graduate specialist. 
Nor does it of itself guarantee that the courses provided for 
general or "distributive" purposes shall be suflficiently gen- 
eral. "Everything of something" does not mean that the 
undergraduate must be brought quickly to the point of view 
of the scientific scholar; "something of everything" does 
not mean that the undergraduate should be given unrelated 
views of many subjects, however leamed the instruction. 
To be effective for general culture the material of every 
course, whether elementary or advanced, should be built 
into a growing understanding of the whole field within which 
the course lies. From the standpoint of culture, thus con- 
ceived, it cannot be assiuned that imdergraduate "concen- 
tration" necessitates research, or that imdergraduate "dis- 
tribution" is satisfactory if in the study of any subject in 
any "group" the student may escape without a general and 
related view of the courses he selects. If, therefore, this 
general aim of college instruction is to be accepted and 
worked out to its logicai conclusions, undergraduate courses 
in any field ought, it would seem, to be organically related 
so as to strengthen and deepen the student's general grasp 
of that field, and instruction in every course ought to be in 
some measure broadly interpretative of the whole subject; 
fiuthermore, in every "group," Schedules of related general 
courses for "distributive" use ought to be arranged, and the 
instruction in those courses ought to include some effort to 
reveal the relations of the departments of knowledge in that 
group and of that group to other groups. The statements 
of aim in the Economics courses do not show the results of 
concerted effort to work out in this or in some other way the 
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cultural purpose on which they seem to be based, although 
the new requirements for concentration in the Division of 
History, Government, and Economics, and the requirements 
for the several degrees with distinction in this division are 
important steps toward that end. 

In Economics itself, however, it may be supposed that 
the purely cultural aim cannot be strictly adhered to, at 
least in courses designed chiefly for concentration. De- 
parture from that aim is in faet indicated in the vocational 
reference of several of the statements and in the faet that 
direct social applications of a decidedly practical charac- 
ter are also often in view. Indeed, these statements (and 
a glance at the titles of Economics courses in the Elective 
Pamphlet) bring home the conviction that the purely cul- 
tural aim is too indefinite to be accepted as the complete and 
suflficient purpose of a college education in which such a 
subject as Economics is to have any considerable part. In- 
struction in Economics for purely cultural purposes cannot, 
it would seem, be adequate, even for imdergraduate ends, 
in a imiversity college. Direct preparation both for voca- 
tion and for general social service would appear also properly 
to enter as a factor in the aims of instruction. 

This statement has no reference to the obvious desirability 
of relating instruction in Economics to actual economic 
problems, simply as a matter of method. Many of the re- 
plies to the questionnaires show that such reference is de- 
sirable, although not always attempted. It is a principle 
of teaching now generally accepted that, other things equal, 
the best way to begin the teaching of any subject is to bring 
the student face to face with concrete problems which cannot 
be satisfactorily solved except through study of that subject. 
Continuous touch with the concrete is, furthermore, an 
advantage in leaming which is usually worth great pains to 
secure. But direct preparation for dealing with practical 
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problems demands more than this. The use of preluninary 
problems in the section meetings of Economics A has aroused 
interest, engendered a new motive for leaming, and given 
point to the class discussions; but it has not supplied the 
necessary conditions (in that course, to be sure, not requisite 
conditions) for practical preparation. Preparation for work 
of any importance or difficulty demands intensive study of 
actual problems of the work and a method that closely ap- 
proximates (or better, that includes) practical experience. 
Theoretical imderstanding becomes merely a half-way stage 
in progress toward practical efficiency. In j5ne, vocational 
or other concretely applicable preparation is not merely 
study, but training. 

The measure in whichsuch trammg should be made the 
aim of any course, or of any part of any course, in Econom- 
ics, it is not within the province of laymen in that subject to 
discuss. By what methods, in what courses, and imder what 
conditions practical aims shall be realized in actual instruc- 
tion only the expert in the field can determine. The sole 
point here in question is recognition of the students' prac- 
tical purposes and the efifort to satisfy them in such ways 
as are appropriate and possible. At present no statements 
of aim and no annoimcements of courses even imply their 
existence, much less describe methods designed to meet them. 
The layman can only suggest that use of such methods is de- 
sirable, on general educational groimds, for most students 
who make Economics their major study. For specialization 
in this field cannot commonly be considered complete with- 
out it; and specialization in college particularly demands it, 
since college concentration is usually imdertaken not for the 
purpose of preparing to teach, but rather for participation in 
the affairs of govemment, philanthropy, or business. Even 
the prospective Ph.D. ought, it may be supposed, to have 
some directly practical training; but the prospective Ph.D. 
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is but one in twenty ^ of those who concentrate in Econom- 
ics. The rest are to be workers in other fieids. Their educa- 
tion in Economics would seem to be incomplete unless it 
leads to the beginnings of practical power in addition to 
general understanding. 

It may be said that the Business School is the place in 
which such power should be developed; and the general 
principle may be advanced that all vocational and other 
practical training should be graduate training, undergrad- 
uate concentration being reserved wholly for intensive study 
under purely cultural ideals, or for the purposes of pure 
scholarship. (The faet that only a few college men can 
afford Business School training does not affect the fimda- 
mental question, although it may long have administrative 
importance.) But complete preparation for a professional 
career may readily be assigned to graduate schools, yet the 
permanent question here at issue remain undecided. For 
there are reasons for doubting the wisdom of a policy which 
makes pure scholarship the dominant aim of college concen- 
tration in every field and for every student. Concentration 
in such a subject as Comparative Literature favors, if it 
does not actually necessitate, the ideal of pure scholarship ; 
but in Economics, as in other social sciences, the underlying 
reference is so intensely practical that a curriculum of six 
courses without the saving element of practical training 
must often make for remoteness and unreality. The desire 
to take part in the work of the world is strong in normal 
college men. To be sure, a decided intellectual interest 
may in many cases be a better basis for concentration 
than a weak or vague vocational or social purpose; in 

^ Based on actual count of Harvard graduales retuming for advanced study 
in Economics. Of 460 Harvard undergraduates concentrating in Economics dur- 
ing the period 1913-17 not one has finally received his Ph.D. in Economics from 
Harvard University, although 16 have undertaken some graduate work and a few 
more will doubtless do so nezt year (1917-18). 
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other cases the impulse toward participation in active life 
may be satisfied by student enterprises, concentration serv- 
ing to engage such purely scholarly interest as the student 
may have or acquire ; and possibly concentration in Econom- 
ics may thus in some cases be made to minister to purely 
scholarly interest, or to feed a specific intellectual appetite: 
but it would seem safer to admit that its natural relation 
is with practical purposes, vocational or social. The choice 
of this field commonly means that the student intends to at- 
tack economic problems as a part of his life work, either in 
his vocation or in other social activities. If he has no such 
intention, it may be doubted that he is acting wisely to 
specialize in so practical a science; his specialization, in 
that case, ought at any rate to be determined with care. If 
his intention is clear, or becomes so, his specialization, it 
may be contended, ought to include, perhaps to culminate 
in, direct practical training. 

This argument is based on the conviction that a college 
education which results in culture alone — that general 
understanding of life which makes leisure significant and 
holds all interests and activities in balance — is for many 
students inadequate, perhaps indeed impossible: it seeks to 
justify actual preparation for specific duties and obligations 
as an important element in many college curricula. But it 
does not support the claim that the college should train 
for professions, or that every student should be forced to 
choose one course which gives direct training for special 
activities. Its immediate object is to present the importance 
of vocational and other strictly practical aims in some parts 
of college instruction in Economics, especially in some of the 
courses that are meantprimarily for concentration. Whether 
any changes in the instruction now offered, and what changes, 
the acceptance of this conclusion would involve, the Divi- 
sion of Education is naturally qmte incompetent to con- 
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sider: the question here at issue, although it involves the 
problem of adopting methods of practical training, is in it- 
self solely a question of aims. It is a question, however, not 
only of aims in any particular course, but even more largely 
of aims in planning student curricula, and specifically, curric- 
ula for concentration. 

Concentration is, indeed, the rock in the way of accept- 
ing pure culture as an organizing principle in the teaching 
of Economics. It is easy to see that Economics A, as an 
introductory survey of the subject, chosen in large part by 
men who do not intend to concentrate in Economics, may 
well take but little accoimt of specific vocational or other 
practical purposes. However necessary it may be to con- 
sider such purposes in organizing sections and directmg 
students' work, the instruction itself must doubtless be 
occupied with the task of presentmg contemporary economic 
organization and its major problems for the sake of deter- 
mining attitudes, training students to think in economic 
terms, and clarifying the relation of Economics to other fieids. 
Economic history must obviously be taught from a similar 
point of view. Perhaps this point of view is essential in 
other courses. The course in Accoimting seems to be the 
only course in which it would seem clear, even to the layman, 
that the cultural purpose would be wholly out of keeping and 
practical training the only natural character of the work. 
The only generalization the layman may safely venture is 
that the intentions of the students admitted to the course — 
and hence, fundamentally, the student purposes the course 
is designed to serve — should be the determining factor in 
the definition of its aims and accordingly in the assignment 
of its place in student curricula. (The intentions of students 
cannot be accepted, to be sure, in the crude and half-f ormed 
State in which students themselves often hold them: the 
purposes of youth need modification and reformulation if 
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they are to be taken into account in providing courses; yet 
they must still remain our chief reliance in the organization 
of curricula.) In courses chosen for distribution or intended 
to serve as beginnings in concentration, the cultural aim 
may be appropriately dominant, and methods need ap- 
proach those of practical training only in so far as good 
teaching demands it and conditions permit. In some courses 
designed for concentration (e. g., the middle-group course 
in Economic Theory) the cultural purpose is apparently 
prescribed by the subject. To what extent vocational and 
other practical aims may be kept in view in other courses 
for concentration would seem to depend on the factor men- 
tioned — the purposes (properly interpreted) of the students 
admitted to the course. 

Among these purposes vocational and social-service aims 
are surely of great importance. If they exist, they ought to 
be known; if they do not exist, the student's curriculimi of 
concentration ought to be afifected by that faet. To urge a 
student to ignore them or thrust them aside in choosing his 
concentration would seem to be justifiable only if he has also 
a strong scholarly taste or interest and can serve his practical 
purpose by a "minor concentration" in his "free" courses. 
The problem is at bottom a problem of educational guid- 
ance. The aims of courses ought to be stated in terms of 
effort to meet the needs of students; descriptions of courses 
framed with explicit understanding as to the student pur- 
poses the courses are intended to serve; instruction guided 
by full possession of all available data as to students' Out- 
look, interests, and intentions. 

The Division of Education recognizes the faet that the 
new Schedules for concentration in Economics may well 
have been frdmed according to principles determined after 
full consideration (perhaps, of course, consideration re- 
sulting in views adverse to those here expressed) of the issues 
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presented in this chapter. The chapter is written without 
other data in view than those submitted in the statements 
of aim and those supplied by the pamphlets and Communi- 
cations of the Department. If any part of it oflFers sugges- 
tion for profitable discussion by the Department, the faet 
that the rest is inapplicable will be of small moment. 

Supplementary Note 

This chapter inevitably suggests the whole problem of iinder- 
graduate training for the professions and the meaning of the bach- 
elor's degree. In its present solution of this problem the University 
has adopted a policy in many respects liberal: no single subject (ex- 
cept for a fundamental course in English) is required for the degree, 
and no distinction exists between the A.B. and the S.B., except the 
requirement of admission Latin of candidates for the degree in Arts. 
The required English course may be "anticipated" in the admission 
examinations, and it is not impossible that the argument for a single 
bachelor*s degree (the A.B.), without reference to Latin, may even- 
tually prevail; so that in time any student may secure the baccalau- 
reate degree in Harvard College on a course defined, from entrance 
to secondary school through the period of undergraduate training, 
only by broad rules for the selection and organization of studies. In 
one respect, however, the University has been more conservative as 
to the bachelor's degree than many other American institutions: it 
has refused to coimt toward the degree any professional courses. The 
most notable present exception to this rule is the counting of a few 
strictly professional courses for teachers — e.g., Education 9, the 
course for supervised practice in dass-room instruction; and it is 
now proposed that a Graduate School of Education shaU be estab- 
lished to take over as soon as possible all work in this field. 

The ideal of a non-professional undergraduate course is clear, and 
the Division of Education desires to take no stand against it. It is 
undoubtedly advisable for many institutions to begin professional 
training with the jimior year in college or even earlier; but it would 
seem equally advisable for some to maintain the f ull course of liberal 
studies for the A.B., without admixture of strictly professional work. 
For those who can afiFord the time — it has been amply proved that 
entrance to college a year or even two years before the common age 
of entrance is both safe and advantageous — the full "liberal" course 
in arts provides a highly desirable opportimity for the maturing of 
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general interests, attitudes, and views, for adventure in scholarship, 
and for the definition of practical and social purposes. It is only for 
this last phase of the whole opportunity we would here contend. 
College work in subjects with a practical trend and outlook ought 
finally, even in Harvard, to take for many students a practical tum, — 
which means, not that the student should be brought suddenly 
under the full control of vocational ideals, as if he had entered a 
professional school, or that vocational training be made the major 
aim of his upper-class courses, but that his vocational purpose be 
recognized in his choice of courses and Schedules, and the practical 
usefulness of certain parts of his instruction frankly avowed. 
After certain general courses, taught for purely cultural purposes, 
shoidd come Schedules of courses leading toward entrance into the 
purely professional work of the graduate schools or bearing on the 
work of the occupation itself. Concentration according to such 
Schedules should be permitted as freely as concentration in a single 
subject or a set of academically related subjects, on the basis of 
scholarly interest. The courses need not be technical, narrowly 
"practical," or in any way prematurely "professional": but their 
relation to each other in the concentration schedule should be openly 
determined by the vocational objective on which they all bear. It 
is the frank avowal of the vocational aim of certain combinations 
of courses that is important. The courses themselves may deal with 
matters more or less remote from the occupation in view, provided 
that in combination they afford a sultable preparation for truly 
vocational study, and are so advertised. The extent to which any 
given course shall include training of a strictly practical character is 
in any case a matter for adjustment in each course; but this plan 
necessitates no particular amount of practical work at any prescribed 
point. 

Indeed, this plan oflfers a means of maintaining the generally "lib- 
eral" character of the baccalaureate cxirriculum, with allits advantages. 
It does not force the choice of a profession. It does not hamper the 
teacher of every upper-class course by prescribing for his instruction 
a vocational outcome. But it does permit students whose vocational 
purposes are already defined to shape their work in accordance with 
their intentions. It fosters in others, but not unduly, the tendency 
to define such purposes. It should prevent waste of eflFort and 
simplify the problem of the adviser. 

Professor Day suggests that in Economics the necessary guidance 
shoidd be given by the Tutors. This is doubtless desirable, and in 
making the connections between courses the Tutors can do much 
service by clarifying the relation between the study of college Eco- 
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nomics and the work to which individual students may be looking 
forward. It will still be necessary, however, to establish and publish 
sequences of courses, and to state in the Department pamphlet the 
bearing of courses on preparation for vocations or on vocational 
training in a graduate school. And outside the field of Economics, 
Schedules of other courses — e.g., courses preparatory to the study 
of medicine — ought to be established as approved Schedules for 
concentration. 

In such Schedules continuity of intellectual eflfort and unity of 
Outlook must, of course, be safeguarded: a schedule that is merely a 
hodge-podge of imrelated courses would be at least subject to sus- 
pidon, even if it could be justified on the groimd of vocational in- 
tent. Some present concentrations, however, lack unity, or at least 
seem to lack it, if one considers only the names of courses; and ex- 
perience with concentrations in Mathematics and Education (per- 
mitted because there is a field of that name, in which one may be 
a candidate for the degree with distinction) shows that a vocational 
purpose can hold together studies which differ considerably in content. 

This chapter is essentially an argument for giving up academic 
distinctions and catalogue divisions as a basis for determining curric- 
ula, and tuming to the realities the rules are meant to serve — the 
purposes and interests of students and the fieids of endeavor and in- 
terpretation in life. 



CHAPTER III 

QUANTITATIVE STUDIES FROM STUDENTS' 
RECORDS — STUDIES IN CORRELATION 

I. EcoNOMics AND Other Subjects — Trend of Student 

Elections 

An attempt is made in this section of the Report to deter- 
mine, in general, what kind of students pursue courses in 
the Department of Economics. 

In the first place, the scholastic interests of the students 
concemed, — in so far as they are indicated by the election 
of courses outside of the Department, — have been studied. 
There is an impression that the students who do the best 
work in the Department show a distinctly scientific and 
mathematical bent. This opinion, however, is not borne 
out by their election of courses. 

The choice of studies in the case of a thousand students of 
the Department was first canvassed. These students had 
taken on the average between three and f our half-courses in 
Economics. The courses taken outside the Department 
were classified for the purposes of this study into three 
groups: (i) History, Government, Education, Philosophy, 
Psychology, Social Ethics, Music, History of Religion, and 
Fine Arts; (2) English, Comparative Literature, German, 
French, Latin, Greek, Italian; (3) Mathematics, Geology, 
Physics, Chemistry, Astronomy, Engineering, Physiology, 
Anatomy, Zoology, Botany, and Mining. 

Among the one thousand records, there were thirty-five 

which showed the election of twelve or more half-courses in 

35 
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the Department. This number of courses would seem to be 

siÆcient evidence of specialization in Economics. The 

elections of these students outside the Department are 
shown in the f ollowing table, classified according to the above 
mentioned groups : 

TABLE I 

Student I H m Total Tendency 

I 9 9 .. i8 I-II 

2 12 6 4 22 I 

3 lo 9 8 27 I-II-in 

4 II 9 4 24 I~II 

S ...... 10 7 2 19 I 

6 10 8 s 23 I-II 

7 8 8 s 21 I-n 

8 s 8 .. 13 II 

9 II S I 17 I 

10 10 6 . . 16 I 

II 6 II .. 17 II 

12 2 IS . . 17 II 

13 2 6 10 18 ni 

14 7 6 .. 13 I-n 

IS 8 S S 18 I 

16 II 2 I 14 I 

17 7 6 10 23 III 

18 9 2 3 14 I 

19 13 8 6 27 I 

20 10 7 4 21 I 

21 14 12 2 28 I-II 

22 6 II .. 17 n 

23 7 8 4 19 I-II 

24 7 10 10 27 n-m 

2S 12 3 I 16 I 

26 2 14 2 18 II 

27 10 . . 6 16 I 

28 II II 4 26 I-n 

29 6 8 6 20 i-n-m 

30 I 12 4 17 II 

31 21 s 2 28 I 

32 II 6 6 23 I 

33 II S 4 20 I 

34 14 16 I 31 I""II 

35 9 7 16 I-n 

Explanation of Table I: To show the field m which a student's work lay, 
the record for each student was classified according to the number of haU- 
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courses taken. This was done in the following way: if the total number of 
half-courses was less than twenty, the number in the maximum group 
must be greater than the sum of the other two, in order to be considered 
as sufficient evidence of concentration. If the total number of half-courses 
was over twenty, there must be a plurality of at least three half-courses. 
If there was not a plurality of at least three half-courses, the groups were 
combined. 

TABLE n 

(Table II is a summary of the result of Table I) 

Group 

I 14 

II 6 

III 2 

I-II IC 

I-II-III 2 

ii-m I 

35 

Explanaiion of Table II: This means that of those students who took 
twelve half-courses in Economics, fourteen, or 40 per cent, were interested 
decidedly in what are termed purely cultural subjects; six, or 17 per cent, 
specialized in language; and only two, or 5 per cent, were students of the 
mathematical and "scientific" subjects. Ten, or 29 per cent, were students 
who took the orthodox college course of language and cultural subjects; 
two, or 5 per cent, had an evenly distributed coiurse. The group which 
combined I and II was clearly inclined away from the scientific side, towards 
the established academic course. Therefore, if we add groups I and I — II 
(14 -f- 10 = 24) we find that 68 per cent of the students were not especially 
interested in the subjects of the third group. Further, if we distribute the 
six students of Group II on the basis of their inclination towards I or III, 
we find that four took no courses in Group III and are concemed only with 
I and II; that one has two courses in each of II and III; and one is in favor 
of III. We may therefore add these four (24 -f- 4 = 28) which would in- 
dicate that about 80 per cent of the students in question are chiefly 
interested in the studies of Groups I and II. 

The cards of all the students of the Department between 
the years 1904-05 and 1912-13 were then classified on the 
basis of specialization in one or the other of the three groups. 
Only students, in the first place, who had taken two or more 
courses in Economics; and, in the second place, only those 
who by electing eight or more half-courses in one of the above 
groups gave evidence of some specialization in these various 
groups, were considered. Of the eight hundred and ninety- 
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nine records thus selected, one hundred and fifty-six fell in 
Group I; five hundred and twenty-two in Group II; and 
two hundred and twenty-one in Group III. 

Table III shows the grades which these men received in 
Economics. 

TABLE m 



A 
B 

c 

D 
E 



I 


n 


m 


26 


35 


28 


54 


114 


43 


52 


253 


los 


19 


103 


40 


3 


17 


5 


154 


522 


221 


17 


58 


25 



Totals 154 

Per Cents of Whole Group 1 7 

Table IV gives the same facts reduced to percentages, e. g., 
17 per cent of Group I received A in Economics as com- 
pared with 7 per cent of Group II and 13 per cent of Group 
III. Taking the grades A and B together, 52 per cent of 
Group I receive superior grades in Economics; 29 per cent 
of Group II; and 33 per cent of Group III. 







TABLE 


IV 






I 




n 


m 


A . . 


. . 17% 




7% 


13% 


B . . . 


. 35 




22 


20 


C . . 


. 33 




49 


48 


D . . 


. . 12 




20 


18 


E . . 


. . 2 




3 


2 



Conclusions: A study of the records of the elections of 
approximately nine himdred students of the Economics 
Department shows that about three-fifths (58 per cent) of the 
students concentrated in their work outside of the Depart- 
ment in the language group of studies. About one-fourth 
concentrated in Mathematics and Science, and less than a 
fifth (17 per cent) in a group of studies including History, 
Government, Philosophy, and Fine Arts. The students, how- 
ever, who concentrated in this last group of studies (Group I) 
received superior grades (i. e., A or B) in their courses in 
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Economics in about a fif th more of the cases than did the 
students who were classified in either of the other groups. 
There is no reason to believe that Economics has any natural 
aflSliation with mathematics and science or that interest in 
mathematics and science promises well for success in 
Economics. 

II. Distribution of Grades m Courses m Economics 

AND m Sections of Course A 

In the following table, the grades given to thirty-eight 
hundred and sixty-three students in Economics A are shown, 
and secondly, the grades received by eight hundred and 
ninety individuals in the more advanced courses in the 
Department. These eight hundred and ninety individuals 
had each taken six or more half -courses beyond Economics 
A. For purposes of comparison the grades have been re- 
duced to percentages and thek distribution shown in Plate I. 

table v 

Distributions of Grades in Economics A and in Advanced Courses 

A B c D £ Totals 

Economics A 364 987 1874 523 115 3863 

Per Cent in Economics A . . 9 26 49 14 3 

Advanced Courses 603 2041 3398 718 164 6924 

Per Cent in Advanced Courses 9 30 49 10 2 

The grading, as the table and chart show, is somewhat 
higher in the advanced courses. The smaller number of the 
E and D grade students electing advanced courses is suffi- 
cient to account for this difference. It is to be noted, fur- 
ther, that the distributions are not symmetricai, there being 
a somewhat larger proportion of A and B grades given than 
of D and E grades. 

Uniformity of marking on the part of the individual in- 
structors in the Department would doubtless be promoted 
by giving some attention to the general practice of the De- 
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partment, as shown in these distributions. This statement 
should not be construed as meaning that the marks assigned 
by an instructor to a small group of students should neces- 
sarily even approximate to these distributions. Quite the 
contrary: It would seldom happen that an instructor's 
"sampling" of the student body, in the case of any one 
class, would be an exactly average "sampling," — which 
is what would be indicated were he to distribute his marks 
according to the percentages given above. But in the 
course of several years the grades in his various classes or 
sections should, when totaled, approximate the above dis- 
tribution, unless, to be sure, there were exceptional factors, 
e. g., election of the course by a superior grade of students 
only.^ These more general questions are discussed in the 
chapter on Marking. 

The above distributions represent the average results of 
the marking of the instructors of the Department. Instead 
of reconciling differences in standards by striking an average, 
it would doubtless be better to set up a standard upon which 
several of the instructors already agree, — if a Department 
is f ortunate enough to have such agreement and provided 
there is a reasonable basis for the agreement. For the pres- 
ent, however, it may be sufficient to take the above distribu- 
tions as representing the general standard of the Depart- 
ment of Economics. 

The question of the imiformity of grading in the Depart- 
ment has been studied more specifically in the case of the 
section grading in Economics A. These sections are, in 
the first instance, f ormed without reference to the quality of 
students, so that in the course of a few years, at any rate, 
each instructor should have seoured about the same pro- 

^ In an unpublished study of marking in Harvard courses A. J. Inglis has shown 
that even a standard distribution based on the combination of marks in large in- 
roductory courses cannot saf dy be used as a basis for distributions in upper class 
courses. 
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portion of the various grades of students, and if his assign- 
ment of grades dififers much from the general practice, it 
must be accounted for in other ways, e. g., marked supe- 
riority or inferiority of instruction, — matters which then 
may reasonably be inquired into. 

The grades given in the several sections of Economics A 
during the years 1913-14 and 1914-15, including both 
mid-year and final marks, have been tabulated. The re- 
sults are shown in the following tables of percentages and in 
the accompanying charts (Piates II to VI inclusive).^ 
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As may be best seen from the charts, there is a much 
greater diversity of practice than can be accounted for on the 
basis of differences in the quality of students in the various 
sections. Furthermore, only in the case pf one instructor 
(D) is there agreement between the proportions of grades 
assigned at the mid-years and at the finals. In general, there 
is a larger proportion of low grades given at the mid-years. 
This is due in part to the dropping out of the poorer stu- 
dents after the mid-years, in part to an actual improvement 
in the performance of the students who remain. The em- 
ployment of a standard at the mid-years more severe than 
the standard employed at the finals could have no justifica- 

^ At mid*years, an AA section, so-called, is formed by selecting those 
doing A-grade of work in the various sections. The marks for these sections 
are included only in the combined distribution of the final marks as shown in 
Plate VI. 
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tion except in a dangeroiis theory of marking for "moral" 
eflfect. As the chapter on Marking points out, the only 
advisable course in assigning grades is to use every eflfort to 
be accnrate at the time the grade is assigned. 

One instructor (C) has a perfectly symmetricai distribu- 
tion of grades at the finals, which dififers very markedly 
from any of the other section distributions, and also from 
the general distribution of grades shown in the preceding 
chart. This would imply a conscious use of the "probabil- 
ity" distribution curve. This practice, we believe, is not 
justifiable. The employment of a fixed form of distribution 
in the case of a small group of students is bound to do in- 
justice, since no two successive groups, except by chance of 
definite selection, will be the same in the proportions of the 
various grades of students. If any form of distribution is 
to be followed, that representing the practice of the De- 
partment as a whole in the marking of the total group will 
do least injustice. 

III. Elementary Cotjrses and Advanced — Correla- 

TION OF ElECTIONS AND OF GrADES 

A. The Relation of Economics A to the Advanced Courses 
of the Department. Seventy-one and nine-tenths per cent of 
the students of Economics A elect fiu-ther courses in the 
Department. This percentage is based on the records of 
3856 students during the years covered by this investiga- 
tion. The extent of fiu-ther elections beyond Economics A 
is shown in Table VII and in Plate VII. 

TABLE vn 

NXTMBE&S AMD PeR CeNTS OF STUDENTS TAEING GnE OK MoSE CoURSES 

No. of Courses i 3 3 456 7 8 o 10 zz za 13 

Number . 1083 301 569 349 363 308 243 191 152 112 74 48 63 
Per Cent of 

Students 28 8 15 9x0 8 6 5 4 3212 
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In addition to the number of students, it is also a matter 
of interest and concem to the Department to know some- 
thing of the kind of student who goes on. Do, for example, 
the students who receive grade D in the introductory 
course continue in equal mmibers with those who receive A? 
Standing in the introductory course is, of course, not a final 
indication of the student's fitness for further study, but it is 
" contributory " evidence. 

The facts as to the continuance in the Department of the 
A, B, C, D, and E men of Economics A are shown in Table 
VIII and in the accompanying plate (Plate VIII). 

TABLE vni 

Number of A, B, C, D, and E Men Who Took One or More 

Courses in Economics 

No. of Courses z 33 4 5 6 7 S 9 10 xi Z2 13 Totals 

A men 96 20 57 26 37 29 24 15 20 16 9 5 12 366 

B men 290 65 136 75 95 61 64 65 54 35 19 11 14 984 

C men 481 156 276 183 171 171 118 92 63 54 40 28 34 1867 

Dmen .... iS4 53 87 59 49 44 31 16 12 6643 S24 

Emen 62 7 13 6 11 3 6 3 3 i o o o 115 

Totals ..... 1083 301 569 349 363 308 243 191 152 112 74 48 63 3856 

The students who receive the grades of B and C in the 
introductory course are in the large majority in the advanced 
classes. In actual numbers there are more D men who con- 
tinue than A men; only in the coimt for more than eight 
courses do the A men begin to outnumber the D men for 
each additional course. 

If one considers the total nimiber who take six or more 
courses (883 cases), the following are the findings: 

A B c D £ 

loi 262 429 78 13 

"% 30% 49% 9% 1% 

The percentages for the various numbers of courses taken 
are shown in Table X.^ Fifty-four per cent of the E men 

> See below page 47. This table repeats Table VIII in percentages. 
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do not continue. About equal percentages of D, C, and B 
men (26 per cent- 29 per cent) and a somewhat smaller 
percentage of A men (23 per cent) do not continue. There 
is a distinct difference to be noted between the A and B 
men in Economics A, on the one hånd, and the D and E men 
on the other. The data, however, do not show whether part 
of this difference is due to the faet that D and E men leave 
college altogether. If a man leaves college, of course he 
does not take advanced courses in any department, Eco- 
nomics among the rest; so that in the group of those who 
take from six to twelve advanced courses a lower percen- 
tage of men of any given standing is produced by those 
who drop out of college, as well as by those who stay and 
prefer to do thek work m other departments. 

Speaking in general, then, about one-half of those who 
receive E in Economics A continue in the Department, and 
approximately three-fourths of those receiving each of the 
other grades. 

Leaving out the question of the E men, some of whom 
doubtless leave college, the grade received in the intro- 
ductory course appears to have no particular eflfect on elec- 
tions of advanced courses in the Department. 

Another way of grouping the students of Economics A 
is according to the grade of the advanced courses taken by 
those receiving the various marks in Economics A. " Grade '* 
here means only the distinction between a course that is 
open to both graduates and undergmduates, and one that 
is open to graduate students exclusively. The differences 
in the extent of elections in the lower, middle, and upper 
group courses may be seen in the accompanying chart 
(Plate IX). Thus, of the 46 per cent of men who received 
E in Economics A and took further courses in the Depart- 
ment, 45 per cent took only those courses open to both 
undergraduate and graduate students, only 0.9 per cent tak- 
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ing exclusively graduate courses, this being a single indi- 
vidual. The 71 per cent of the D men who did some ad- 
vanced work in Economics did it exclusively in courses open 
to undergraduates. Of the C men, only 0.5 per cent took 
exclusively graduate courses, ten individuals out of eighteen 
' himdred and seventy-f our. A slightly larger percentage of 
those who received B in Economics A took exclusively 
graduate courses, 0.8 per cent, or eight individuals out of 
nine himdred and eighty-seven who received B in Eco- 
nomics A (a smaller number, but a slightly larger propor- 
tion). In the case of the A men of Economics A, both the 
actual niunber and the proportion is greater, for eleven 
men out of three himdred and sixty-four who received A 
in Economics A went on to exclusively graduate courses. 
This is 3 per cent, or the same proportion of A men as took 
twelve half-courses beyond Economics A. 

The grouping according to grade of courses serves to 
differentiate between those who received A in Economics A 
and those who received B. Actual numbers of individuals 
are as f oUows in our data (Plate IX) : 

TABLE DC 

Number of Economics A men in study 3863 

" who took exclusively graduate courses 30 

" of these who were A men in Economics A . . . . 11 

" who were B men in Economics A 8 

" who were C men in Economics A 10 

" who were D men in Economics A o 

" who were E men in Economics A i 

If the same proportion of the B men in Economics A took 
exclusively graduate courses as of the A men there would 
have been thirty instead of the eight. The same proportion 
of the eighteen himdred and seventy-four C men would 
have given fif ty-seven, instead of ten. Considering the dis- 
proportionately large niunber of A men who take exclusively 
graduate courses as compared with the B, C, and D men. 
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it may be said that the grading in Economics A has to a 
certain extent differentiated the students, since it gives A 
to a third of the men who af terwards take exclusively grad- 
uate courses, whereas it gives A to only about a tenth of the 
whole niunber of Economics A students. It gives B to about 
one-third of those who af terwards take exclusively graduate 
courses and to four-tenths of all the students in Economics 

A, from which it may be deduced that a man receiving A in 
Economics A is f our times as likely to go on to exclusively 
graduate courses as is the man in Economics A who receives 

B. In other words, the proportion of A men in Economics A 
who take exclusively graduate coiu'ses is f our times as great 
as of the B men. The rule of the Department that only 
candidates for the degree with distinction shall be admitted 
to graduate courses practically excludes from them all but 
the A and B men. 

The general conclusions as to the connection between 
grades in Economics A and the election of advanced courses 
are: (i) About twice the proportion of A and B students take 
six or more courses in Economics beyond Economics A as D 
students. The proportion of C students is midway between. 
(2) The proportion of E students who take courses beyond 
Economics A is only half that of all other grades. Oiu" data 
do not show what part of this is due to E students dropping 
entirely out of college. (3) Foiu" times as large a percentage 
of A students take exclusively graduate courses as of B 
students. (4) Standing in Economics A does not greatiy 
deter or incite to fiu'ther elections in the Department, but 
it is fairly reliable as an indication of a student's probable 
advance into strictiy graduate study. 
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TABLE X 

Tabus Showing Pe&centages of those Receiving the Vasious 

Grades in Economics A who Elect Different Numsers of 

Advanced Courses in Economics 

Number of Half -counes Beyond Economics A 
Grade in 
Economics Ao za 345678 gxoxzxa 

A . 

B . 

C . 

D . 

E . 



23 S 16 7 10 8745 42 I 3 

29-748106775 42 I I 

26 8 14 10 99653 32 I 2 

29 10 17 II 98632 I i 0.7 0.5 

54 6 II S 10 3 S 3 3 0-8 



B. The Relation between Grades in Economics A and in 
Other Courses in the Department of Economics. The previous 
sub-section reported the facts as to the sort of students 
who elect advanced courses m the Department, judged on 
the basis of their grades in the introductory course. It is 
also of interest to inquire whether the grades obtained in 
the introductory course give indication of the probable 
standing of the students in the advanced courses of the 
Department. Is there reason for encouraging an A student 
in Economics A to elect advanced courses rather than a D 
student; and is the A student more likely to receive higher 
grades in these coiu-ses than the D student? 

Eight himdred and ninety individuals are included in this 
study, each of whom took six or more half-courses beyond 
Economics A.^ The distribution of the marks in Economics 
A was that 96 received A; 268 received B; 420 received C; 
78, D; and 28, E. The percentages are as follows: A, 11; 
B,3o;C, 47;D, 9;E, 3. 

The A men of Economics A received seven himdred and 
thirty-eight marks in advanced courses, about a third of 
these being A's. The B men of Economics A received two 
thousand and fifty marks in advanced courses, a tenth of 

^ Seven additional cases to the 883 discussed in section A of this chapter have 
been induded in this part of the study. 
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these being A's. Of the marks in advanced studies given 
to men who stood D and E in Economics A, only one in 
fif ty was an A, while the C men in Economics A succeeded 
once in thirty times in getting an A in advanced conrses. 
These facts are shown in the A row of the table, showing 
the percentage of A's in advanced courses obtained by A 
men, B men, etc, of Economics A; e. g., thirty-five per 
cent of the marks in advanced courses of men receiving A in 
Economics A were A, forty-four per cent of their marks in 
advanced coiu'ses were B, etc. 

TABLE XI 

Table Showing the Percentages op the Vamous Mabks in 

Advanced Courses in Economics Obtained by those 

Receiving the Various Marks in Economics A 



Marks in 
Advanced Couises 


A 


Maries in Economics A 
B c 


D 


£ 


A . . , 


35 


10 3 


2 


2 


B . . . 


. 44 


44 ^' 


10 


13 


C . . 


20 


40 60 


5S 


SS 


D . . . 


I 


6 13 


23 


23 


E . . 


0.2 


0.8 3 


7 


6 



The heavy-faced type indicates what is called "absolute 
retention"; that is, sixty per cent of the marks of the C men 
of Economics A were also C in the advanced courses. This 
is the percentage of perfect retention. The italic indicates 
"approximate retention"; that is, twenty-one per cent of 
the marks of the C men were B in the advanced conrses, and 
thirteen per cent were D, so that the total "approximate 
retention" here is thirty-four per cent. The grades which 
are stUl fnrther dispersed from the grade in Economics A 
are printed in ordinary type. The greatest scattering of 
the grades in the advanced courses is in the column of 
the E men, half of whose marks in the advanced courses 
are C. The E men of Economics A receive about the same 
proportion of C's in the advanced courses as do the C men 
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and D men. Fifty-fonr marks out of ninety-fonr given in 
advanced studies to men who had received E in Economics 
A were C. 

These facts are clearly shown in the series of graphs in 
Plate X. In general, it is evident that the practice of the 
Department is to lower the grades of the A and B men who 
continue in the Department and raise the grades of the D 
and E men. This practice, there is every reason to beKeve, 
misrepresents the facts of the case and is due largely to the 
artifidalities of grading. It is reasonable to beKeve that the 
A and B men of the introductory course are quite as capable 
of at least maintaining their rank as the poorer students 
are of improving theirs. To offset this conclusion Professor 
Day has suggested that certain men do good work in ad- 
vanced courses of a more or less practical character, whereas 
the general and largely theoretical character of the intro- 
ductory course may make it difficult for them to get marks 
of distinction. 

The actual nimibers of marks received by the various 
groups of students in the six or more additional half-courses 
are as f oUows : (from this table it is possible to calculate the 
degree of closeness in agreement between grades m Eco- 
nomics A and in the advanced courses). 

TABLE xn 

Table of the Dotesent Grades in Advanced Courses in Economics 
Received by Students Receiving the Various Grades in Economics A 
WHO took Sdc or more Half-Courses in Economics Beyond Economics A 







Marks in Economics A 






Marks in the 














Advanced Courses 


A 


B 


c 


D 


£ 


Sums 


A. . . 


258 


205 


100 


II 


2 


576 


B . . . 


325 


944 


703 


57 


12 


2041 


C. . . 


147 


862 


2006 


33T^ 


52 


3398 


D. . . 


7 


123 


435 


131 


22 


718 


E. . . 


I 


16 


lOI 


40 


6 


164 


Sums . . 


738 


2150 


3345 


570 


94 


6897 
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The product-moment (Pearson) coefficient of correlation 
between grades in Economics A and advanced courses in 
Economics of those who took six or more advanced half- 
conrses is r = + 39.4 per cent. It will be of interest to 
compare this coefficient of correlation with those given in 
Section IV. It indicates but a small amount of relation be- 
tween the standing of students in their introductory and 
advanced work. This is probably in large part a misrepre- 
sentation of the facts, due to a somewhat arbitrary lowering 
of the grades of the superior students of Economics A and 
an equally arbitrary raising of the grades of the inf erior stu- 
dents; but in itself it shows that standing in Economics A 
is not, imder present conditions, a very reliable guide to 
probable standing in advanced courses. 

One further point of interest in connection with the rela- 
tion of grades in the introductory and advanced courses may 
be mentioned. The grades in Economics A of students who 
go on to the extent of taking six or more half-courses are 
on the average somewhat higher than the grades of those 
who take fewer courses. In order to secure these averages, 
the f oUowing values were given to the grades : A = i ; B = 2 ; 
C=3;D=4.5;E=6. (Cf. Appendix A, below.) The 
grades of the eight himdred and ninety students who took 
six or more courses average 2.69; of those, twenty-nine hun- 
dred and sixty-six in mmiber, who took less than six courses, 
the average grade is 2.90, which is about one-fifth of a grade 
below. The students who go on to do much work in Eco- 
nomics stand higher than those who do not. This supple- 
ments the conclusion presented above as to election of 
advanced courses. The^ futiu-e specialist in Economics is 
marked by what he does in course A; but a man who does 
poorly in that course may nevertheless take a good many 
advanced courses and do well in them. 

Of even more significance are the differences among the 
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groups which elect individual courses. The average grade 
in Economics A of those who subsequently take Economic 
Theory is very high, 1.76; pf those who take Economic His- 
tory, 2.54; of those who take Money and Banking, 2.66; and 
of those who take Sociology, 2.64. This shows that there 
is marked variance in the average abilities of the groups 
selected by the advanced courses. It is worth while for an 
mstructor to know the standing of his men, not only in the 
introductory course in his department, but in the whole 
range of each student's work. A brilliant group of students 
should not be taught or marked as an ordinary, imselected 
group. 

The recent decisions of the Department conceming elec- 
tion of graduate courses by imdergraduates do not afiFect the 
conclusions of this section, for the data were gathered from 
the students' records in years before the decisions were made, 
and the problems involved persist in spite of them. 

IV. Economics and Other Subjects — Correlation of 

Grades 

A. The Significance of Carrdations. When comparison of 
the grades received by the same students in two different 
courses shows that those who receive A in the one also re- 
ceive A in the other, B in the one, also B in the other, and 
so on; or when it shows a tendency to such agreement so 
marked as imquestionably to be more than a matter of 
chance; and especially when one pair of courses shows such 
positive correlation much more markedly than another pair 
— then it is evidently worth while to discover the factors at 
work in producing so noticeable a result. Thus Economics 
A and Mathematics C show a correlation of 58 per cent — 
an agreement more than half complete; whereas Economics 
A and Admission Civil Government show no correlation at 
all, their coefficient ( — .01) being so near zero as to indicate 
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no significant relation whatever between the two series of 
marks. What do these facts imply? 

Granted that the students are really the same — that they 
are not only the same persons, but that their general capac- 
ity for work, their determination to succeed, and their power 
of assimilation remain imchanged, then the only other factors 
which can operate to produce or prevent correlation are, 
first, the closely related character of the subjects as they are 
presented to the student by the instruction he receives, and 
second, the accuracy with which the instructors estimate 
each student's achievement. It is natural to suppose these 
factors operative in producing such a correlation as that 
between Physics C and Mathematics C, which is .61. 

The fimdamental capacity of the student does not, of 
course, remain always exactly the same; his vitality varies 
even from day to day, and a change in health or circimi- 
stances may make a marked change in that mysterious 
"central factor" of intelligence which imdoubtedly plays 
an important part in intellectual accomplishment: but this 
factor, as a nimiber of studies^ show, does remain fairly 
constant, "good students" persisting throughout their 
whole scholastic career (and, so far as has yet been deter- 
mined,^ later in life as well) in capturing the "high marks". 
Positive correlation may therefore be explained in part on 
the groimd of persistence in relative native ability, including 
in that term the important element of purpose or wiU. 

This tendency of native ability to give men the same rank 
in two courses no doubt has something to do with a correla- 
tion such as that between Economics A and Government I, 
which is .56; but on the basis of such an explanation we 

^ Dearbom, W. F. The Relative Standing of Pupils in the High School and 
in the University, Madison, Wis., 1909. 

* Cf. President Lowell's study of College Rank and Distinction in Life, Atlantic 
Montfdyf October, 1903, also President Lowell's study of College Studies and 
Professional Training, Educational RevieWf October, 191 1. 
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might here expect an even higher correlation, since these 
coiirses attrået men of about the same age and college stand- 
ing: also, how shall we accoimt on grounds of native ability 
for the difference between the correlations of Economics A 
— Government I, which is .56, and English A — History I, 
which is only .40? The men who take these courses are prac- 
tically the same; they form a large group, without much possi- 
ble variation in native ability from one course to the other. 

There can be no question of the faet that native ability 
is cailed forth in diflfering degrees by diflferent subjects — 
that the students who respond to and work effectively in 
some subjects are not equally stimulated by others. The 
appeal of a subject is affected, of course, by the method of its 
presentation and by the personaHty of the teacher; yet it 
may legitimately be supposed that these factors will not, 
ordinarily, so greatly disturb the relative rank of students, 
on which the calculation of a correlation coefficient is based, 
as to obscure the effect of the subject itself on the var5dng 
character of their minds. Positive correlation may also be 
taken to indicate, therefore, that the requirements of two 
subjects are germane — that they appeal in equal degree 
to minds of equal capacity, and similar interests, and that 
for the student, the vital question of probable success in 
study may receive the same answer in both. To take one 
of these subjects may be supposed to be helpful in taking 
the other, either because of relation in the content of the 
subjects or because of relation in the point of view or habit 
of attack required. This similarity of content or method 
probably helps to produce the relatively high correlation 
between Economics A and Government I, and the even 
higher correlation (.67) between Economics A and the ad- 
vanced course in Economic Theory, although in the latter 
case it is possible that other factors, to be mentioned later, 
are also at work. 
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Positive correlation presupposes the same degree of ac- 
curacy in marking. It cannot be said that any marking is 
very accurate; justice, as a later chapter of the Report points 
out, is almost as difficult in marking as in the law. But 
granted an equal effort to be just and granted bases of judg- 
ment not essentially diflferent, the variations from accuracy 
in the case of two instructors will not f atally disturb the 
action of other factors in bringing about the same distribu- 
tion of ranks in their two courses. Standards may vary 
without any effect on correlation, provided students of all 
ranks take both the courses in question; for mere severity, 
equitably applied, will not prevent students at the top of 
the list in an "easy " course from being at the top of the list 
in a "hard" one. But low correlation, or absence of cor- 
relation, or negative correlation, may indicate that marking 
in one course is based on considerations given little weight 
in another; as for example, when in one course a student 
may eam a C or a B by virtue of careful, well-organized, 
faithful work, whereas in another he is required to show 
imagination or graces of form in themes or essays. The low 
correlation between Economics A and English A (.27) may 
perhaps be accoimted for on these groimds. Such a differ- 
ence in principles of judgment may be considered an aspect 

« 

of the difference between one subject and another: but 
in certain cases it may indicate that marking in a given 
course is not well regulated or based on clearly conceived 
requirements. 

One other possibility in marking may aflfect correlation, 
namely, the possibility that only the good students in one 
course (of the correlated pair) take the other, and that in 
that other, the marking is relatively high : — then correla- 
tion will also be high. This may be partly the case in the 
Economics A — Economic Theory correlation, as facts 
presented at the end of Section III suggest. It was there 
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shown that the average grade of men taking Economic 
Theory was very high, namely, 1.76 (or approximately B +) 
and the coeffident of correlation is correspondingly high, — 
(.67). Or if only poor students in one conrse take the other, 
and the marking is high, then correlation will be low — and 
other cases can be imagined. If correlation is not to be 
obscured by differences of standard, students of all ranks 
must be present in both courses. The method of correlating 
explained below is especiaUy devised, however, to discoimt 
ordinary differences in the "form" of distributions — e. g., 
the difference between an instructor who habituaUy gives 
10 per cent of A's and an instructor who never gives more 
than 2 per cent. 

On the whole, it must be admitted that the significance of 
many of the correlation coeflScients here reported is in good 
part a matter of conjectiu'e. None of the correlations we 
have worked out is strikingly high; only one is negative; but 
some are much higher than others. Those who know the 
courses must consider the various possible explanations for 
difference in correlation between any two pairs. In the 
case of two pairs of large coiu-ses, such as the pairs Econom- 
ics A — History I and Economics A — English A, relative 
native ability as a factor may be dismissed. These courses 
get students of all abilities; and on that score the correla- 
tions of the two pairs should be the same. Difference in 
correlation between the two pairs must indicate differences 
in the relations of the subjects or in the bases for marking. 
There is also the possibility that really marked differences 
in the effectiveness of the teaching would appear in such 
differences of correlation; for if of two coiu-ses it were true 
that good teaching in each won successful effort from stu- 
dents in approximately equal degree, whereas of two others 
it were true that one secured it in high degree, but the other 
only from those who could not be discouraged by any teach- 
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ing, however uninspired, then the correlation of the j&rst 
two, other things equal, would be much higher than that of 
the other two. No conrses we have correlated can be said 
to vary in any such way, but variations in effectiveness of 
teaching do of conrse exist, and they cannot be left wholly 
out of account. 

It is not safe, in any case, to draw the conclusion that the 
training given in one course is of advantage in another, 
merely because the two correlate, or that the training in one 
is barren of results in the other because they do not corre- 
late. But when courses do correlate, it is reasonable to ex- 
pect that a student who has done well in one will do well in 
the other, and hence to advise him for his own sake to take 
it — or if one's philosophy so dictates, not to take it. 

B. Corrdations — Economics and Other Subjects. The 
method by which the main set of correlations (given in 
Table XV) was calculated is explained below. It dififers 
somewhat from the method in common use, and makes 
certain appreciable differences in the ranking of the various 
pairs of courses, as to correlation. In order to calculate the 
correlations it was necessary to translate the letters A, B, C, 
D, and E, into nimierical values, which were assigned as 
follows: A = I, B = 2, C = 3, D = 4.5, E = 6. This 
Schedule was adopted after a study of the grouping of the 
grades given in various courses.^ 

The j&rst set of correlations was calculated in order to ob- 
tain an average correlation for typical pairs of courses not 
including any course in Economics. It would be desirable 
to get correlations for a larger nimaber of pairs, in order to 
secure an average correlation more widely representative of 
the various subjects taught in the college; but the average 
correlation obtained is useful enough for the present purpose. 

^ For a discussion of the evaluation of grades see Appendix A, at the end of 
this section. 
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TABLE Xin 

COKBELATIONS ^ IN PaIRS OF CoURSES NOT INCLX7DING ANY 

COURSE IN ECONOMICS 

Coefficient of 
Number of Correlation 

cases Courses (r « ) 

Physics B or C and Mathematics C or F . . . .55 

History i " Government I 54 

German A or B " Latin A or B 53 

English A " History I 32 

English A " Philosophy A 28 



182 
890 
276 
114 
68 



1530 

The weighted average of the coefficients of correlation for 
these pairs is .50. This figure may be taken as a guide in 
deciding whether a given correlation between Harvard 
courses is high or low. It, as well as the separate correla- 
tions of Table XIII, is reckoned by the "product-moment" 
(Pearson) method (coefficient designated "r"); and would 
have been somewhat higher if reckoned by the "rank-dif- 
f erence-squared " method (coefficient designated "rho"), 
by which the longer list of correlations given in Table XV 
was calculated. The range of the correlations in Table 
XIII shows the amount of difference in the tendency of 
different pairs of courses to cause shifting of ranks. 

Table XIV gives correlations between Economics A and 
various other courses, both in Economics and in other sub- 
jects. These are also reckoned by the "product-moment" 
method, and may be compared directly with the correla- 
tions given in Table XIII. 

^ Coefficients of correlation are in terms of r, the "product-moment" method 
of Pearson. 
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TABLE XIV 

COKRELATIONS BeTWEEN ECONOIOCS A AND OlHER COXTXSES 



('*Piodttct-momeiit" formok) 



Numberof 
cases 

167 

143 

510 
263 

334 

387 
81X 

346 
528 
439 
6897 
432 

334 
168 



Coeffident of 

Correlation 

(r-) 



Counes 

Economics A and Mathematics C 52 

Economic Theory 51 

Government I 51 

Money and Banking 50 

German A or B 48 

Sociology 48 

Econ. History U. S 47 

Physics B or C 46 

History I 42 

Mathematics F 40 

All other £kx)nomics courses ... .39 

Chemistry I 36 

Latin A or B 33 

EnglishA 23 



tt 



ti 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



tt 



The weighted average of these correlations is 41. 

The faet that only three correlations in this list are higher 
than the average for the pairs listed in Table XIII and none 
as high as the three highest of that five, deserves some com^ 
ment. It is due in part to the faet that the "product- 
moment" method of calcnlation takes no accoimt of the 
differences in habit of marking between two instructors, 
as is explained below. By the " rank-diff erence-squared " 
method some of these correlations are considerably higher 
in the total list. (See Table XV.) Even so, the only courses, 
outside of other Economics courses, with which Economics A 
correlates particularly well are Mathematics C and Gov- 
ernment I. An explanation for the correlation with Gov- 
ernment I is suggested above; ^ the correlation is not un- 
natural, since the two courses are large under-class courses, 
not \mrelated in content. Is it possible that the correlation 

^ It is interesting to note that in reply to the questionnaires a large number 
of students reported Government I as the most helpful course in its relations to 
Economics. 
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with Mathematics C is due to an inherent relation between 
Mathematics and Economics, or to the faet that both conrses 
are highly systematic and demand continuous application 
of an analogous character? Neither conclusion can be 
adopted without facing the faet that Economics A and 
Mathematics F show a correlation of only 40.3 (see Table 
XIV); Economics A and Admission Algebra of only 21.6 
(see Table XV). The facts reported in Section I of this 
chapter'are also against either conclusion. If it can be 
shown that these correlations are low because of peculiari- 
ties in the way marks are assigned in Admission Algebra 
and in Mathematics F, the conclusion that Mathematics 
and Economics are inherently related will be strengthened. 
In general, it may be said that Economics does not show 
any marked relation to any other field, but in this respect 
is probably not very different from other college courses. 
On the other hånd it is much better in these respects than 
English A. The correlations of English A with History I, 
Philosophy A and Economics A are the lowest, with the 
exception of the admission subjects. Markedly low cor- 
relations give reasonable groimd for question as to the stand- 
ards of marking used, or the character of requirements, or 
both. The low correlations with admission subjects shown 
in Table XV, below, are of much significance, especially in 
view of the faet that high-school marks and college marks 
correlate much higher. (Cf . note to Table XV, and Section 
V of this chapter.) 

The foUowing table gives the complete set of correlations, 
calculated by a modification of the rank-difference-squared 
method of Spearman, which, for reason discussed in Appen- 
dix B at the end of this Section, was considered to be appli- 
cable to these cases. It includes a number of correlations 
with admission subjects, and these, it will be noticed, are 
all low on the list. 
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TABLE XV 
CoMPLETE List of Coxxelations ^ 

Peecentaoe or CoRSELAnoN Given by Mbthod or RANK-DirrBSSNCE 
n Pair of Courses p 



Squarbd 



143 
x82 

8ii 

167 

S 10 

263 

890 

276 

334 
346 
528 

387 

6897 

439 

432 

334 

114 

68 

20 

168 

3365 

3479 

3165 

341S 

42 



« 



« 



(( 



« 



« 



« 



Economics A vs Economic Theory 67 

Physics B or C VS Mathematics C or F 61 

Economics A vs Economic History U. S 59 

Mathematics C 58 

Government i 56 

Money and Banking 56 

History i vs Government i 54 

German A or B vs Latin A or B 54 

Economics A vs German A or B 51 

Physics B or C 49 

History i 47 

Sociology 46 

Marks in Ec. A vs average in Other Economics . . 44 

Economics A vs Mathematics F 43 

Chemistry i 42 

Latin 41 

English A vs History i 40 

" Philosophy A 31 

Economics A vs Admission Economics 29 

" English A 27 

" Admission Latin 26 

" " Algebra 21 

" " Science 21 

" " English 08 

" " Civil Government . . — .01 



tt 



tt 



P. E. Rank 




inp 


3 


X 


3 


2 


3 


3 


3 


4 


2 


5 


3 


6 


2 


75 


3 


7.5 


3 


9 


3 


xo 


2 


XX 


3 


X2 


I 


13 


3 


14 


3 


IS 


3 


x6 


5 


17 


7 


18 


14 


19 


5 


20 


I 


21 


X 


22 


I 


23 


I 


24 


10 


25 



^ For puxposes of comparison with the coeffidents of correlation given above, 
some others based on similar materials may be mentioned. E. A. Lincoln, in a 
study published in School and Society for April 7, 1917, foxmd a correlation between 
the high school and Freshman marks of Harvard Freshmen of r — 67 +• The 
grades A, B, C, D, and E were given in this study the percentage values of 95, 
83, 68, 53, and 35. The results of Dearbom in the case of the ranks of 238 pupils 
from the Madison (Wis.) high school show a correlation with their standing in 
the Freshman year at the University of Wisconsin of r = 66.8. A general group 
of 472 pupils from several high schools showed a correlation between standing in 
high school and standing in the Freshman year at the University of r >■ +80. 
These studies, as well as that of Lincoln, are correlations of average standing in 
several subjects, and are not directiy comparable to correlation between single 
subjects. Rietz in a recentiy published study foxmd a correlation of r >■ 0.528 be- 
tween the standing of 161 students in their college courses in Mathematics at 
Dartmouth and their standing in the Dartmouth Law School. 
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The only additional comment suggested by these tables 
concems the faet that Economics A correlates rather poorly 
with all other Economics courses taken together. This may 
be due in part to the faet that in this case a correlation is 
made between a single mark in the one course and an average 
of marks in other courses. There is, however, a more im- 
portant factor: the coefficient is based on the marks, 6897 
in all, of students who took six or more half-courses beyond 
Economics A. That there is a somewhat arbitrary shifting 
of the grades of students between the elementary and ad- 
vanced courses has been pointed out in Section III. The 
low correlation depends chiefly on this factor. 

In order that the comparison in this case may be seen 
more in detail, the following tables, which show the per 
mille distribution of students by grade in the introductory 
and advanced courses, are added. 

The marks in the advanced courses are divided into five 
horizontal rows according to the grade in Economics A. 
Table (a) represents the distribution of 1000 marks in courses 
beyond Economics A of students who took six or more half- 
courses in Economics beyond Economics A. This is based on 
the actual distribution of 6897 such marks. 

Table (b) represents the distribution of 1000 marks in 
advanced courses in Economics based on the actual distri- 
bution of marks in four courses, Economic Theory, Money 
and Banking, Sociology, and Economic History of the U. S. 
There were 1604 in the actual distribution. 
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TABLE XVI 
Fes Mille Distributions of Grades in Advanced Courses in 

EcONOmCS, COMPARED WITH THE GrADES IN ECONOIOCS A 

(a) GsADBS In Advanced Half-Courses in Econoiocs or Tbosk Who Toor Szx 

OE More Beyond Economics A 



Grade in 














conomics A 


A 


B 


C 


D 


E 


Sums 


A. . . 


• 37 


47 


21 


I 


O.I 


106 


B . . . 


• 30 


137 


"S 


18 


2 


312 


C. . 


. . 14 


102 


291 


63 


IS 


485 


D. . 


. . 2 


8 


48 


19 


6 


83 


E. . 


. . 0.3 


2 


8 


3 


I 


14 



83 296 493 104 24 



(b) Grades in Four Advanced Coxtrses; Econouic Theory, Money 
AND Banking, Socxology, Economic History 



Gnde in 
Economics A 


A 


B 


C 


D 


E 


Sums 


A. . . 


. 54 


86 


27 


2 





169 


B . . . 


22 


133 


127 


16 


4 


302 


C. . . 


4 


76 


262 


81 


13 


436 


D. . . 


. 0.6 


XI 


44 


25 


S 


86 


E. . . 


. 0.6 





4 


2 


I 


8 



81 306 464 126 23 

In such tables, where the "base" is the same, comparisons 
can be readily made, since simple additions of certain col- 
imans, rows, or diagonals immediately give comparable fig- 
ures. For instance, comparable figures for the "absolute 
retention" can be immediately foimd by adding the prin- 
cipal diagonals. For the general table the absolute retention 
is 485 per mille. For the four special conrses it is 475 per 
mille. The "approximate retention" foimd by summing 
the adjacent diagonals is 424 per mille for the general table, 
and 443 per mille for the four conrses. 

The sum of the changes in rank of the general table is 613, 
and for the fom: courses 614. The sum of the squares of the 
changes in rank is 823 for the general table, and 809 for the 
four special courses. The faet of larger sum of squares in 
the general table agrees with the lower correlation foimd for 
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the general set of maxks in advanced conrses than for the 
particular courses, since the correlation measure employed 
is based upon the squares of deviations from the average, and 
not upon the original deviations. 

The practice of the Department noted above (p. 49) 
appears clearly from Table XVI. In the general table, 172 
A's and B's in Economics A were shifted a rank down- 
ward in the advanced courses, against 37 A's retained and 
30 B's advanced to A's; whereas 51 D's and E's were 
shifted a rank upward against i E retained and 6 D's 
lowered to E's. The facts are even more striking in the 
table for the four courses. 



APPENDIX A 

In order to carry out the correlation studies, the results of which 
are presented in this chapter of the Report, it was necessary to assign 
numerical values to the grades of A, B, C, D, and E. The values em- 
ployed were as follows: A = i; B = 2; C = 3; D = 4.5; and E = 6. 
DiflFerent values are given to D and E because it is believed that the 
step between C and D and the step between D and E are somewhat 
greater than the steps between A and B and B and C. Grades D 
and E penalize the student in the way of university credits, etc, and 
they are, therefore, assigned, in general, more sparingly. In the case, 
for example, of 3863 grades assigned in Economics A, the percentages 
are as follows: 

E D c B A 

2.98 13.53 48.51 25.55 942 

The units adopted are admittedly only approximations. The at- 
tempt was made to calculate them more exactly on the basis of the 
relative frequency of grades assigned, but as the latter varies from 
distribution to distribution, the above approximations, for which 
there was also some justification in the percentile equivalents which 
are sometimes employed in the Recorder's office, were finally chosen. 
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APPENDIX B 

A MODIFICATION OF THE SpEARMAN RaNK — DiFFEKENCE 
SQUARED MeTHOD OF CORRELATION 

The formula of ærrelation suggested by Bravais (1846) to which 
Pearson gave the name "product-moment" is based on the assump- 
tion that the variants in the two series of events in question, — in 
the present instance college marks in pairs of courses, — are each 
distributed according to a "normal" or Gaussian curve of frequency, 
or would be were a sufficient number of cases obtained. The correla- 
tion formulae by the method of ranks (or the order of merit of the 
individual in the group) as proposed by Spearman, assume a rect- 
angular form of distribution and also assume that the imit of rank 
which separates any two individuals or scores is the same or equal 
throughout the scale. Ih the Gaussian curve of frequency the dis- 
tances which separate any two individuals may be practically zero 
near the centre or mean of distribution, and very large at either ex- 
treme of the distribution. None of these various assumptions alto- 
gether holds for the five rank distributions of marks which are dealt 
with in this investigation. As indicated in Appendix A, the imits of 
rank, in this case the distances between the grades A, B, C, D, and 
E, are probably not equal, and have been difiFerently evaluated for 
use in this study. The distributions of marks in college courses, — 
although for the most part asynunetrical, since more grades of A and 
B are given than of D and E, — approximate much more nearly the 
Gaiissian or bell-shaped form of distribution than the rectilinear. 
There is, however, some justification for using a rank-difiFerence 
method of comparison, since, as noted, the distances between the five 
ranks have been &ced in the assigning of numerical values. 

Both formulae assimie further that the general form of distribu- 
tion in the two series to be compared or correlated is the same or 
would be the same were there a sufficient nimiber of cases. This is 
an assumption which ought to hold in many cases in the assigmnent 
of grades, e. g., the range or distribution of abilities of five hundred 
men in an introductory course in Economics will certainly not difiFer 
materially from their distribution in many other introductory courses, 
and espedally if all courses are equally open to free election. This, 
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of course, does not mean that the same men wiU hold the same ranks 
in the two subjects, but that if there are ten men of very superior 
(or A) rank, and fifty of high, but not superior (or B) rank, etc, in 
Economics, the same proportions should hold in, e. g., History or 
Government. In many of the distributions compared, however, this 
is not the case, and in some instances there are reasons why it should 
not be the case; whereas in other instances the distribution of marks 
can only be explained on the basis of arbitrary differences in the 
methods of assigning grades. 

This faet may affect the possible extent of correlation in a given 
pair of courses. The amoimt of correlation depends mainly, of 
course, on the number of changes in rank, e. g., if few, there is a high 
correlation, if many, a low correlation. K we suppose, in the above 
mentioned case, that from year to year ten men are given A grade in 
History, whereas but one man is given an A grade in Economics, it 
is evidently not possible for the ten highest men in Economics to 
secure the same rank as in History. Such changes in rank as these, 
which are caused by differences in the general form of distribution 
of grades, if these differences are purely arbitrary, should not be per- 
mitted to affect the correlation of the two courses — that is, the ex- 
tent to which men in one group maintain the same rank which they 
hold in the other. A modiffcation was therefore introduced into the 
rank-difference formula to discoimt or neglect differences in rank 
brought about in this way, and has been applied equally to all the 
pairs of courses compared. In some cases this is doubtless not fair, 
because there may be reasons which justify the distribution of grades 
employed. In view of this and other considerations mentioned above, 
it is not imlikely that the product-moment formula may give, on the 
whole, equally accurate correlations. 

The formula used was worked out by Mr. H. A. Sturges and is as 

SD^obt. — SD^min. 

follows: P = I — ^r^r; , OTX9 » 111 which SD^obt. = the sum 

SDTnax. + SD^nm. 

2 

of the actual differences in rank; SD^iin. = the sum of the differences 
in rank caused by differences in the forms of the distribution; and 
SD^ax. = the sum of the maximum possible differences. The differ- 
ences are in each case squared before summing. A similar modifica- 
tion of the product-moment formula might have been desirable but 
was not attempted. 
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V. ECONOMICS AND ADMISSION StANDING — CORRELATION 

OF Grades 

The correlations between admission subjects and Econom- 
ics were included in the general table in Section III, above. 
They were, as there noted, the lowest of the correlations 
fonnd. It is questionable, however, whether the figures 
really mean what they wonld seem to mean: namely, that 
there is little or no relation between the standing in school 
studies and university studies, or a given university study, 
such as Economics. There is, on the contrary, good reason 
to believe from other investigations that the relation be- 
tween the general standing in high school studies and uni- 
versity studies is close.^ The low correlation here is due, it is 
believed, to the standards of marking which prevail in the 
entrance examinations.^ This may be seen in part in the 
lower averages of the grades assigned in the entrance exam- 
inations compared with those assigned to the same pupils 
in the Economics course. These averages are shown in the 
following table, which gives also the correlations in terms of 
r (the product-moment formula). There is no reason why, 
in the case of such large groups of students as are listed in 
f oiu" of the comparisons, the average grade should not be the 
same in the two cases. 

^ Cf. W. F. Dearbom, Relative Standing in High School and University. 
Bulletin of the University of Wisconsin. 

'' In a study published in School and Society for April 7, 19 17, £. A. Lincoln 
has shown that in the case of a considerable group of Harvard Freshmen, the 
relation between the standing of these pupils in high school and their standing in 
the university is much doser than the relation between their standing in the 
entrance ezaminations and their university standing. 
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TABLE XVn 






GXADES 


m EcoNOiacs A Compased with 


GxADES OF AmassioM 








IN Sdc Sxtbjects 








in Aoiinissioii 


Admisstoo 


Average Grade 
in 




Nomber 


Study 


Study 


EconomicB 


r 


20 


4.27 


Economics 


2.80 


21.8% 


3165 


3.08 


Science 


2.88 


173 


3365 


3-53 


Latin 


2.88 


ISS 


341S 


3*95 


English 


2.89 


131 


3479 


3.14 


Algebra 


2.88 


11.8 


42 


4.10 


Civil Gov. 


2.82 






In order that these comparisons of standing in the exam- 
ination subjects and the standing in Economics might be 
studied in greater detail, the results were also put into the 
form of distribution tables. For the purpose of this com- 
parison, the groups in question were in each case divided into 
five divisions according to their standing in the admission 
subject in question. The tables in the case of Admission 
English and Admission Latin are here given as examples. 
The first fifth of the group (numbered i) are the students 
ranking highest, the second fifth are the students ranking 
next highest, etc. The group is then also divided into fifths 
on the basis of standing in Economics A, and the tables are 
arranged to show how many of those who were in the first 
fifth of the grouping in the admission subject remain in the 
first fifth of the Economics grouping, and how many are 
shifted into the second, third, fourth, or even fifth divisions 
of the Economics grouping. 

The figures in black face type show the cases of "ab- 
solute retention"; those who are shifted but one division, 
either lower or higher, show the extent of "approximate 
retention." 
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TABLE XVm 










English-Adiossion 






Economka A 


X 


a 




3 


4 


S 


Totals 


I . . . 


5 


35 




146 


135 


9 


330 


2 . . . 


5 


49 




291 


448 


42 


835 


3 . . . 


9 


54 




549 


911 


112 


1635 


4 . . . 


2 


14 




132 


31a 


32 


492 


S . . . 


• • 


4 




35 


73 


XX 


123 


Totals . 


21 


156 




"53 


1879 


206 


3415 






Latin-Admission 






Economics A 


X 


a 




3 


4 


s 


Totals 


I . . . 


a8 


81 




143 


65 


6 


323 


2 . . . 


20 


138 




372 


291 


20 


841 


3 . . . 


23 


171 




<^5 


696 


61 


1596 


4 . . . 


6 


39 




183 


235 


22 


485 


S . . . 


I 


6 




50 


59 


4 


120 


Totals . 


78 


435 




1393 


1346 


"3 


3365 






English-Adiossion 












PXRGBMTAOBS 






Economics^ 


i 1 




a 




3 


4 


S 


I . . . 


2 




II 




44 


41 


3 


2 . . . 


.6 




6 




35 


54 


5 


3 . . . 


.6 




3 




33 


56 


7 


4 . . . 


4 




3 




27 


64 


6 


S . . . 


• • 




3 




28 


59 


9 






Latin-Admission 












Pkrckntaoss 






Economics A 


> i 




a 




3 


4 


s 


I . . . 


9 




25 




44 


20 


2 


2 . . . 


3 




15 




44 


35 


3 


3 . . . 


2 




10 




40 


44 


4 


4 . . . 


I 




8 




38 


48 


5 


S . . . 

^11 • 


.8 

4 


fl t 


5 

M 1 




42 


49 


3 

« 1 



In the following table, the percentages of "absolute" and 
" approximate " retention are shown for each admission 
subject in comparison with Economics A. They show how 
much shif ting about there is, or in other words, how little 
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retention of position there is. This is, of conrse, the cause 
of the low correlations found. It can hardly be supposed 
that so much shif ting of relative ranks is due altogether to 
the difference between a college course and an admission 
subject, especiaUy in view of the comparatively high reten- 
tion of rank as students pass from the high school to the 
college. Methods of marking in admission subjects are evi- 
dently in some degree at fault, or else, which is more likely, 
admission examinations offer at best only imreliable evidence 
of ability. 

TABLE XIX 

PeRCENTAGES of AbSOLUTE AMD OF APPROXIMATE RETENTION 



*er cent. of 
Absolute 
Retention 


Per cent. ol 

Approximatc 

Retention 


27 




72 


31 




79 


32 




77 


30 




73 


21 




62 


35 




60 



English and Economics 

Latin and Economics 

Algebra and Economics 

Science and Economics 

Civil Government and Economics . . 
Admission Economics and Economics . 



VI. Distribution of Grades in Four Advanced Courses 

CORRELATION OF GrADES AND AgES 

A. Distribution of Grades. The results of this study may 
best be presented by an interpretation of the accompany- 
ing graphs (Piates XI and XII) . The courses in question 
are Economics A (for comparison), and Sociologjy Money and 
Banking, Econotnic Theory, and Economic History. The marks 
were taken from the records of students from 1902 to 1913. 
The nimiber of cases considered was: for Economics A, 
3863; for Sociology, 463; for Money and Banking, 230; for 
Economic Theory, 144; for Economic History, 818. Dur- 
ing the ten years covered by our records 3080 men elected 
advanced courses in Economics, the elections in these four 
cases constituting 52 per cent of that number. 
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Plate XI shows the distribution of marks in Sociology 
compared with the distribution in Economics A and the 
combined distribution for all four advanced courses. There 
is an obvious trend toward the higher grades, although it is 
not striking. Plate XI also presents the same comparison 
for Money and Banking. In this case there is a trend toward 
the lower grades, about as clear as is the trend in the oppo- 
site direction in Sociology, Plate XII shows a very decided 
trend toward the higher grades in Economic Theory. In the 
case of Economic History (also on Plate XII) the trend is 
again toward the lower grades, but it is very slight. This 
course shows a distribution very closely in agreement with 
the joint distribution for the four advanced courses. 

It is natural to expect that grades in advanced courses will 
be somewhat higher than grades in the introductory course; 
but the divergence of the grades in Economic Theory from 
the joint distribution for the four advanced courses would 
seem to call for some explanation. It may no doubt be due 
in part to the small niunber of cases considered, as com- 
pared with the numbers in the other courses; and it is prob- 
ably due also to the faet that Economic Theory is known to 
be a difficult subject, which only the more able students 
choose. (Cf. Section III, above, p. 51.) In this course it 
would be especially worth while, however, to examine the 
standard of grading in the light of a knowledge of the grades 
in other courses secured by the men registered in it in any 
given year. 

B. Correlation of Grades and Ages. Piates XIII and XIV 
show in two ways the distribution of grades in Economics A 
to students of various ages compared with total distribu- 
tions selected from the 3863 cases. The first set of graphs 
compares the distribution of grades for six diflferent ages 
with the normal distribution for the course. The second 
compares the range of ages for men receiving each grade 
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with the normal range of ages in the conrse — i. e., with 
the ages of all who took the conrse from 1902 to 1913. The 
graphs show clearly that yoimger men succeed more of ten 
and more fully than older men: m other words, the brilliance 
of the men who enter Economics A at an early age finds no 
obstacle in the character of the course. The conrse does 
not favor, much less demand, maturity. It is "geared" to 
18, 19, and 20. 

In the case of Sociology (Plate XV and Plate XVI) the 
same general result holds, although without quite so strik- 
ingly regular an advantage for the yoimger men. This 
subject cannot be said, however, to put a premiimi on delay 
in taking the course. A larger proportion of yoimg men 
than of old succeed in it. 

The same outcome, less clear, but not imcertain, appears 
m Money and Banking (Plate XVII and Plate XVIII) . (The 
irregularity of the last figure on Plate XVIII is obviously 
due to the small mmiber of cases in question.) 

In Economic Theory (Plate XIX and Plate XX) the tend- 
ency of youth to win fuller success is not so clear. The older 
men are often at an advantage; at any rate, the course does 
not especially favor the yoimger men. 

Plate XXI and Plate XXII show that Economic History 
pays almost no respect to ages. There is a slight advantage 
for men of twenty-three, but it is only slight. 

These graphs, taken together, corroborate the results of a 
previous study, presented herewith among the Supplements 
to this Report (Supplement IV). Young men are not at a 
disadvantage in coUege merely because they are young; 
nor are they at a disadvantage on that account in advanced 
courses in Economics. If a student has proved his ability in 
Economics A, it would be unfair to discourage him from 
entering any of these courses because he happened to be 
nineteen or younger — although possibly he would do well 
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not to try Economics 11 until a year or two later. Youth, 
in fine, is not of itself a handicap, and a yoimg man who 
does well should never be passed by for academic honors or 
encouragement in f avor of another who is his superior solely 
in years. Even the mature man who has gained in seri- 
ousness by several years out of college is likely to be less 
successful than the younger man who has never grown 
intellectually ' ' rusty . ' ' 
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CHAPTER IV 

MINOR STUDIES AND PROPOSALS FOR EXPERIMENT 

I. Habits or Study in Economics A and Other 

Courses 

Habits of study among college students are often the sub- 
ject of discussion and comment, more or less serious, and 
every one knows, from his own experience and observation, 
more or less about them; but no condusions or proposals 
conceming study, as the chief duty of college men, have ever 
been based, so far as we know, on a plain record of the 
actual practices of the students. This part of the Inspec- 
tion is based on a record of that kind — a record which 
might, indeed, be more extensive, but which is reliable as 
far as it goes. 

A member of the Division of Education presented to a 
section in Economics A and to a few other groups of stu- 
dents a request for records of all their studying from Decem- 
ber lo, 1913, to the end of January, 1914. The general 
purpose of the records was explained, although without 
reference to this Inspection; and the students were urged 
not to volimteer to supply records unless they were really 
interested in the problem imder consideration and could 
promise to make their records complete. Seven men from 
the Economics A section volimteered and fifteen men from 
other courses, one of whom, a Junior, was taking Economics 
2 a. The fourteen men from courses in departments other 
than Economics did not all hånd in records of study for their 

full list of courses, so that this study is based on the eight 
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sets of records from Economics students, although the com- 
ments of the other students are also used in the brief final 
discussion. There was no attempt to make this study 
statistical in the sense which implies the counting or aver- 
aging of a large number of records. It was a study of a f ew 
selected cases, for the sake of securing sets of records limited 
in number but complete in character. 

As will be seen from the following record of marks, the 
men were not brilliant; but all were faithful and serious in 
their attitude. 

Mid-Year Gkades — 19 13-14 

Student Economics A Other Couises 

1 DH- English2:B. PhUosophy i: C-|-. French3: A— 

2 D-|- Classical Philosophy 66: B—. History loa: B. 

Comparative Literature 9: A— . English 24: 
C—. History 14: C—. 

3 D— English 27: C. Latin 10: CH-. Music 4: D. 

Social Ethics: 4: B—. Music 3: B—. 

4 C+ English 22: C. English 2: D. Physiology i : B. 

5 CH- Engineering 3: B+. Mathematics 5: B-|-. En- 

gineering 41 : BH-. Physics i : A. 

6 C French 9: B— . Comparative Literature i: C. 

Spanish 5; CH-. Government 17: C. 

7 B Chemistry 3: B. Mineralogy 2: B. Geology 8: 

A— . Geology 10: A. 

8 (Ec. 2a) C German A: C+. History 30a: C. History i6a: 

B. Education A: A. 

The following letter and sample record slip was sent to 
each of the volunteers. 

Cambsidge, December 8, 1915. 
My dear Mr. 

You are among those who gave me their names in response to my 
recent request for cooperation in securing accurate records of the 
study habits of college men. I take for granted, after what I said at 
that time, that I may now rely on you for a serious and faithful eflFort 
to supply me with the data I am seeking. Let me repeat the assur- 
ance that the facts you record will be used only impersonally, as a 
basis for general conclusions, and without the slightest reference to 
the name of the recorder. Your own records will be open at any time 
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to your inspection, in s Lawrence Hall, and I shall be glad to confer 
with you, if you care to have me, on your methods of study or on any 
educational questions which this record may suggest to you. 

You will find enclosed slips on which the records are to be made. 
In making your records please observe very carefully the following 
points: 

I. Make a separate record for each distinct "piece" of study. 
That is, if you tum from one topic to another in the same 
course, or from one kind of work to another in the same 
course, or from the work of one course to the work of another 
course, make a separate record for each. 
II. Record every piece of study immediately at the completion 
of it, or as soon thereaf ter as possible. The purely mechanical 
details of the record may be set down at the beginning of the 
study, and the rest filled out at the end of it, with the ex- 
penditure of very little time. 
III. Be absolutely frank in filling out the records. The back of 
the slip may be used for comment, if the space allotted on the 
front of the slip is not sufficient. 

The enclosed slips need very little explanation. You will find one 
of them filled out as an example. Please let me know at once if you 
discover any difficulty in filling out the slips. You may find me in 
Lawrence s any day at eleven, or you can reach me there by tele- 
phone or mail. The enclosed slips are intended to cover the work 
of a week. I will mail to you a similar set of slips every week. The 
addressed envelope with the slips is for the return of the week's records. 
Please mail them on Saturday so that I may receive them Monday 
morning. Your first set of records should be mailed Dec. 13. 

Under the heading "Material" please give the exact pages covered 
in your study when this is possible; if not, record in some way the 
extent of the material you used. Please note that laboratory work 
and field work should be covered in these records. In such cases make 
a brief statement, under the heading "Material," of the character of 
the work. A piece of mechanical drawing in an Engineering course; 
an experiment in a Physics course; a laboratory test in a course in 
Chemistry; a visit to an institution in a course in Government; these 
are all examples of forms of study, the character of which should be 
recorded imder the heading. 

It may also happen that the work to be recorded will be writing, 
or organizing material for writing. These facts should also be noted 
under the heading "Material." 

Under the heading "Purpose" please state whether the work is 
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done under the general requirements of the conrse, as a part of the 
regularly assigned reading, in special preparation for a set examina- 
tion, or for any other particular purpose. 

Under "Method" record simply the outstanding facts as to your 
procedure. If you memorize headings or take notes on reading, or 
just read straight ahead without pausing to organize the material, or 
work over material you studied into a special form of organization 
for your own purposes, please indicate the faet briefly in your record. 

Under "Comment" please put down in any case your own reaction 
as to the value of the time you spent. If you feel sure that you have 
grasped the material and can remember it, use the term "satisfactory " 
or some similar term. If the work required seemed useless to you, if 
you found no profit in the book you were stud)dng, if the work you 
did confused rather than clarified your ideas — please make an ap- 
propriate record. Under this heading I should be glad also of indication 
of interruptions or distractions which you encountered in your work. 

With the hope that your cooperation in this study will yield some- 
thing to you as well as to others, I am 

Very sincerely yours, 

Sample Slip 

Name: Doe, John H. Course: Economics A. 

Dok: 6 Dec., '13 Hours: 3:30-4:30 Flace: Upper Mass. 
Material: Taussig: Prin. Econ., Ch. 32, pp. 449-467. Chapter on 

Foreign Exchanges. 
Purpose: Regular weekly assignment. 
Method: ist reading for general impression; then outlined by sec- 

tions and paragraphs. Spent 10 minutes memorizing a simi- 

mary, and 20 minutes thinking out typical cases. 
Comment: 1 understand the chapter, but need opportunity to 

follow the details of exchange as actually practised. 

The several sets of record were summarized, both for the 
more mechanical matters and for methods, conmients, and 
general impressions, as shown in the f ollowing example : 

Set I 

(a) Number of records submitted — 119. 

(b) Time spent in study: 

Economics A . Study, on 16 different dates, amounting to 52 hours. 
English 2 . . . Study, on 20 different dates, amoimting to 58 hours. 
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French3 . . . Study, on 12 diflFerentdates, amoiintmgto39hours. 
Philosophy i . Study, on 12 difiFerent dates, amoimting to 30 hours. 



(c) Piaces: 
Economics A . 

English 2 . . . 

French 3 . . . 

Philosophy i . 



(d) Purposes: 
Economics A . 



English 2 . . . 



French 3 . . . 



Philosophy i . 



College room (Stoughton), 13 periods; Massa- 
chusetts Hall, 9 periods; home, 2 periods; Pi Eta 
Library, i period. 

Massachusetts Hall, 19 periods; college room, 8 
periods; home, 8 periods; on trains, 3 periods; in 
dining hall, i period. 

Home, 36 periods; Pi Eta Library, 9 periods; col- 
lege room, 6 periods; Massachusetts Hall, 4 
periods. 

College room, 15 periods; Massachusetts Hall, 9 
periods; Pi Eta Library, 4 periods; home, i 
period; on trolley cars, 4 periods. 



For midyear examination, 12 periods. 

For weekly assignments of reading, 11 periods. 

For review preparatory for section meetings, 2 

periods. 
For midyear examination, 24 periods. 
For lesson of succeeding day, 11 periods. 
For fixing memory passages, 4 periods. 
For midyear examination, 7 periods. 
For lesson of succeeding day, 9 periods. 
For review of preceding lesson, 6 periods. 
For midyear examination, 29 periods. 
For supplementary and advanced reading, 2 periods. 
For making up lecture lost, i period. 
For section meeting, i period. 



This man studied every day from December 10 to Decem- 
ber 18 inclusive, and from January 6 to February 7 inclusive. 
He scattered his periods of study throughout the day, from 
8 A.M. to 2 P.M., but studied more from i to 5 p.m., and from 
8 to 12 P.M., than at other hours. Some of his periods of 
review for midyears were long — one day of "cranmiing" 
for Economics A including an hour and a quarter in the 
morning, f our hours in the af temoon, and five hours in the 
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evening. The commonest length of his periods was an hour. 
He often recorded periods of ten or fif teen minutes. On one 
day he spent five hours at dififerent times on assigned reading 
in Economics A and remarks, "Toward the end my brain 
seemed tired of Economics, and while I could pick out the 
point, it did not seem as vivid." Several records note that 
study late at night "af ter a Symphony concert" is "imsatis- 
factory." 

His method of study in Economics A was good: he read 
the whole chapter or section first for a general impression, 
and reviewed it paragraph by paragraph to fix detafls. Acts 
and scenes in Henry IV for English 2 he håndled in the 
same way. His method of memorizmg for EngUsh 2 was 
more doubtful: he memorized two or three lines at a time, 
adding them to what he already knew. In Economics A 
he committed outlines to memory and he took notes on all 
his reading in Economics and PhUosophy. In French he 
made full use of the dictionary, recording such work as 
"tedious'' but noting the pleasure he secured afterwards 
in rapid rereading of the text. He seldom went over any 
assignment less than twice, often covering a difl&cult assign- 
ment three times. Once he records that in taking notes he 
"made an extra effort to use his own language and seemed 
to get more out of it." 

This man's records give a clear impression of faithful 
effort spent almost wholly in memarizing. He never dis- 
cussed problems in Economics or Philosophy with himself or 
— so far as his records show — with others. His study was 
bookwork — leaming what the text and his reading notes 
and his lecture notes presented. He never records the least 
dissent from what he read, although he sometimes foxmd it 
"dull"; nor does he record any enthusiusm higher than 
"interest." His chief desire, in his own phrase, is to "get 
a firm grip on the material.'' 
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The other sets of records may best be summarized more 

briefly. 

Set 2 

Nmnber of records submitted — 131. 

This man studied dafly form December 10 to December 
18, read much during the vacation and studied daily from 
January 5 to February 6; but he often studied in short 
periods of ten, fifteen, or twenty minutes, on one occasion 
tuming from one subject to another and back again in the 
course of an hour. He studied mostly in the late aftemoon 
and evening. His longest period of consecutive work on one 
subject was four hours and a half in History 10 a. His study 
was continually interrupted and very often casual and 
hurried. 

There is little to indicate any fixed method, either in 
general or for any particular course. He often records 
thinking about the subject before beginning his work, and 
he usually marked or reread significant passages. Once he 
records marking the topic sentences in all the paragraphs 
in a long chapter assigned in History 14. A very common 
remark is to the effect that he got a f ew good points but no 
unified impression. Much of his study has reference to 
written work in preparation, the subjects of which he had 
constantly in mmd. Apparently he did considerable think- 
ing as he studied, retaining of what he read chiefly the 
material which wove itself into his own thought. On the 
occasions when he f ound time for review, he notes especially 
the striking improvement in his understanding of the pas- 
sages as wholes. He notes occasionally his disagreement 
with the author he is reading. 

This set of notes shows much greater activity of mind on 
the part of the student than does the first set. He estimates 
values, organizes materials for use, and picks out ideas which 
interest him. But he works erratically and does not wrestle 
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with problems or cases in point. Economics as a subject 
seems less congenial to him than other subjects, for in 
Economics he suffers more from his tendency to "browse" 
in the subject rather than to concentrate his attention on a 
connected series of problems. 

Sets 

Number of records submitted — 71. 

This man studied in periods of considerable length, con- 
centrating on single subjects. He worked daily from 
December 10 to February 6, omitting Sundays and the full 
Christmas vacation. One record shows study in Social 
Ethics from 1 130 p. M. to 6 P. M. and the next record shows 
study in the same subject that evening from 7 p. M. to 2 A. M. 
This was reading and writing for a thesis and is recorded 
as "intensely interesting work." Periods of two and three 
hours are common. The work fell more often in the after- 
noon than in the evening. 

His method in Economics "is always the same: reading 
for impression, then making a brief." In general, he found 
his reading in Economics easy and sometimes interesting; 
but he evidently did it somewhat perfunctorily. His work 
on Immigration in Social Ethics 4 fascinated him. In this 
course his mind was generally active: he prepared for the 
examination by "considering possible questions and making 
answers for them," a method which might seem like the 
most mechanical "cramming" if it were not for the evidence 
of the other records, which show that he was thinking for 
himself in the subject. His mark in the Course, (B— ), the 
highest he received, reflects this. In preparation for Eco- 
nomics A he read his notes through once and memorized 
diagrams and topic headings. 

His records give a general impression of application 
faithful enough, but never intensive except where personal 



82 THE TEACHING OP ECONOMICS 

interest is aroused in connection with a piece of constructive 
work. He is content to understand what he reads, without 
any strong purpose to possess it, still less to ponder it as a 
matter of real concem — unless he can use it as part of his 
preparation for a theme or thesis. He is the sort of man who 
can best be awakened mentally by the pressure of a practical 
problem or task, seldom by the mere exposition of faet or 
theory in book or lecture. 

Set 4 

Nimiber of records submitted — 75. 

In Engineering Sciences 16 and Mathematics 2 b, both 
courses in which this student was registered during the first 
half of 191 2-13 and the second half of 19 13-14, he spent 14 
hours of study, in all, from December 10, 1913, to February 
6, 1914. His final grade in Mathematics 2b was C—; in 
Engineering Sciences 16, A. In Mathematics C and Physics 
I he helped a friend four times, aggregating about 3}^ hours. 

Student 4 spent much less time in study than Students 
I, 2, or 3. He did no studying on seventeen college days 
during the period from December 10 to February 7, except 
for certain "outside" work during the Christmas vacation: 
thus he lost about 20 days out of 56. He sometimes studied 
early in the morning — on one occasion from 5 to 8; and 
often he studied in the forenoon between 9 and i. His 
longest consecutive study came in the evenings, often 
between 10 p.m. and i p.m., but in general his periods were 
short — usually half an hoiu: or less. 

In Economics he just "reads," remarking once that the 
material is "interesting," but that he "wiU rely in the test 
more on his own reasoning than on the words of the text." 
He worked out voluntarily a few mmierical solutions for 
economic problems and foxmd it "useful drill." Also he 
records "thinking out applications of the principles" pre- 
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sented in the text. Anything in mathematical or scientific 
form appeals to him, but in writing English themes his 
thoughts "do not come freely." In English 2 he foxrnd 
"writing out passages a great help in memorizing." In 
EngUsh 22 he "gets started" slowly, only once recording 
rapid work on a theme, when he wrote "an indignant attack 
on a theme read in class." He always carefully rewrites 
themes, but never takes notes on reading. He records that 
in beginning a book he always reads it through humedly 
first "for a general impression." 

This student's mind works practically: he does best in 
the face of problems, objects, figures, examples; and in 
discussion and exposition. This is indicated by such records 
as the following: 

Date: Week of Dec. 29. Hours: 3:00-11:00. Place: B. & W. 
Power Station. 

Comment: I derived great benefit from this vacation work which 
will help me in my Engineering. I was able to see the appUcation of 
what I had leamed in class. I foiind out a great many new things 
for myself and freely asked questions. The engineers were very kind 
and showed me what they could. I picked up a good idea of the gen- 
eral routine work and repair work. It was of much more value than 
a week's work in class. I leamed a great deal which is never men- 
tioned in class. One oiler trained me on examination questions. I 
spent some time computing data about the engines. 

The contact with the men was of great profit as I believe that it 
is important for an engineer to know how work looks from the work- 
man's point of view. 

If you wish I would gladly report on other vacation work I have 
done which has helped me. 

Date: Jan. 5, '14. Hours: 11:15-12 m. Place: 53 Dunster St. 

Material: Carhart's College Physics. Chapter on calorimetry. 

Purpose: Helping a friend prepare for exam. 

Method: Working and explaining problems. 

Comment: Helps me to keep my hånd in on work that I have 
finished and which I shall need in my Engineering. It is my habit 
to spend time helping my friends. I shall report that until you re- 
quest only my own work. 
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Date: 1/8/14. Hours: 10:15-11:00?. m. Place: 53 Dunster St. 

Maierial: Carhart's College Physics. Calorimetry. Dew point, 
Triple point Humidity. 

Purpose: Helping a friend. 

Method: Explained the text and enlightened dark piaces. Assisted 
with the problems by giving hints and suggestions, also made sure 
that he imderstood prindple. 

This work refreshed my memory of physical constants. Also it 
was good practice in exposition and clearing up misunderstanding. 
The Triple point was also new to me. I had to catch on to the ideas 
and explain after one reading of the text. Trains mental alertness. 

Date: 1/3/14. Hours: 2:00-245?. M. Pl(^^: Room. 

Maierial: Original thought. 

Purpose: Request from railroad fireman for explanation of 
"Linking up." 

Method: Developed engine cards from Zenner diagram; plotted 
work cards and torque of locomotive through complete cycle. 

Comment: I find original work like this of ten of much more value 
than class work. It is good practice in deduction from apparently 
imrelated facts. It develops reasoning power and confidence that 
when I do strike a problem that is not taken up in any text book I 
have seen, I stand a good chance of solving it. This increases re- 
sourcefulness. The results are often of great help in class and at 
work. 

(Note) : Do you wish work that f alls in no course to be reported ? 

Date: 1/10/ 14. Hours: 11:00-11:15 P. M. Place: Home. 

Maierial: Original thought. 

Purpose: Proof that a three-phase current could be transmitted 
over three wires. 

Method: Derivation of formula. 

Comment: Very useful training. Makes me more independent of 
the text book. The suggestion came from a diagram of a three- 
phase current and three-phase transformer. The result is that I 
have a clear conception of what such a current is which I never shall 
forget. 

Date: 1/12/14. Hours: 9:00-10:15 P. m. Place: 53 Dunster St. 

Maierial: Class problems in projection of one line on another in 
space. 

Purpose: Helping a friend. 

Comment: Very good training and think quickly in working out 
problems. Knocks the rust off of my analytic geometry. 
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Date: 4/5/14. Hours: 9:00-12:00 m. Place: Westmoreley 106. 
Material: Friendes notes. 
Purpose: Exam. 
Method: Mutual explanation. 

Comtnent: I think this a very good way to prepare for an exam. 
Seminars of two or three should be gathered together to talk. 

Sets 

Number of records submitted — 80. 

Student 5 missed seventeen days out of 46, including 
eight days in the Christmas vacation. He used every hour 
of the day, from 8 A. m. to i :3o A. M. His periods of study 
are of reasonable length, rangmg commonly from three- 
quarters of an hour to two hours. 

This student was more intelligent and thoughtful than 

diligent. His conaments show independence and critical 

power, but he does not do his work with great care or per- 

sistence. In Economics he "reads once" and "thinks over 

the important points." In Mathematics and Physics he 

works with a friend, doing problems, comparing notes, and 

asking or answering questions. In English he gets clear 

unpressions from a single reading. He is frank in Hs 

criticism of books and chapters but takes the easiest way 

in study. 

Set 6 

Nimiber of records submitted — 34. 

This student missed 27 days out of 44, including the whole 
period (17 days) between December 18 and January 5. He 
studied in the af temoon and evening, seldom in the morn- 
ing. His periods are most of ten only twenty or twenty-five 
minutes in length. 

He slights Economics most, often reading a chapter in 
ten minutes. In reading he takes notes when he has time. 
He has no consdous method of study except in Spanish, in 
which he visualizes sentences in composition and leams one 
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sentence at a time in that way. His cominents show that 
he takes study without much thought: if he understands at 
first reading he calls the period " satisf actory " ; if not, he 
remarks, "Too difl&cult, so gave it up." 

Set 7 

Nimiber of records submitted — 30. 

Student 7 missed only two days, except for the period 
from December 19 to January 6, during which he did not 
study. He always studied in periods longer than an hour, 
usually for at least two hours — but many of these periods 
were in the laboratory. 

In Economics he reads hastily, and records that "it needs 
to be done over again." In other courses he tends to hurry, 
but checks himself , starts over again and goes more slowly. 
When he has objects or diagrams or specimens before him he 
is satisfied with his results, seldom otherwise. On one sUp 
he remarks, conceming "original data on Coral Reefs of 
the Philippine Islands" of which he made a topical outline, 
"Fair. But I would like to return to the Philippines and 
see the reefs again!!" He is not conscious of his methods, 
but does his work steadily, in the handiest way. 

Sets 

Nimiber of records submitted — 98. 

During a period of 68 days this student did no studying 
on 23. (He was a married man, although an imdergraduate.) 
He of ten studied from 5 to 6 in the morning, and in general 
did most of his work in the forenoon, none af ter 11 at night. 
Most of his periods are half or three quarters of an hour in 
length, although on the paper in Education A he worked 
continuously for six hours, and on his thesis for History i6a 
for four and a half hours. 
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Student 8 was by far the most self-conscious in his study- 
ing, of the men in this group. He tried various experiments 
— reading aloud, listening to reading aloud, abstracting 
before study and af ter study, choosing topic-words for a 
set of cards to be run over at odd moments, making digests 
of notes taken by another man, testing his memory of topics 
chosen at random, thinking carefully on selected problems, 
visualizing vocabularies, etc. His best restdts came from 
the time he spent on organizing materials in outUne form 
and fitting illustrative details under appropriate headings. 

These records give strong support to a common impression, 
namely, that college students are engaged for the most part 
in preparing for examinations, tests, and papers and sddom 
look beyond these immediate objectives. The questions with 
which lectures and text books deal are not real to them. Their 
practical business at the moment is to "pass the course." 
Any and all methods and devices which can be used to make 
them f eel the reality and significance of the problems they 
are studying ought to be adopted, even at great risks. 

As to methods of study, the records show that students 
are largely innocent of any knowledge of the dififerent 
requirements of dififerent tasks. They seldom think out 
cases, problems, exceptions, contrary positions, applications, 
or coroUaries. They try to imderstand, fix the material in 
mind, pick out the important points. Instruction in study 
is needed and specific directions for particular pieces of work. 

The evidence in this section agrees admirably with the 
evidence from the questionnaires, from our visits, and from 
other minor studies in supporting the general conclusion 
that there is great and imnecessary waste of time in college 
work. Much of it could be prevented by more careful 
attention on the part of instructors to the problems of 
teaching as such — not merely to modes of presentation in 
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class, but to the guidance of individtials in their leaming. 
To make this possible, however, the University must first 
change its method Of estimating the work a teacher ought to 
carry. The only just way to determine the burden of an 
instructor who is to work individually with his student is 
to use as a imit the "student-hour," with such adjustments 
as the varying character of courses may suggest.^ 

II. Preparatory Questions in Economics A 

This section reports the only experiment in method in 
which we were able to secure quantitative retums of any 
sort, and in this case we should have been glad to conduct 
a more elaborate experiment to test the conclusions here 
reported. The other experiments we hoped to carry out, 
on two of which work was begun, are discussed in the 
following section. The experiments are reported not to 
present results of value in themselves, for they 3delded none ; 
nor to exemplify method in any of its refinements, for our 
method was only generally soimd and the results should 
have been checked in a mmaber of ways; but to show the 
possibilities of experiment and the kind of questions it can 
be applied to. 

Professor Day had had in mind for some time the possible 
advantage of giving to students in Economics A questions 
and problems to be considered in advance of the reading, 
without any requirement of written reports on them, the 
questions being intended simply to sharpen the students' 
interest in their subsequent study. The results of this 
experiment were taken to support the use of such questions, 
and Professor Day and Dr. Davis later published their 

^ See Biige, £. A. " How Many Hours a Week Should be Required of Teachers 
in a University?" TransacHons and Proceedings of the National Association 
of the State Universities, v. 14, 1916. 
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volume of Questions in Economics in order to continue the 
policy. In 191 3-1 4, preparatory questions were used in all 
sections of Economics A, and it was proposed in that year 
that after December 10 the use of these questions should be 
omitted in all but a few selected sections for the sake of 
testing in a new way the effect of their use. It was also 
proposed that the relative advantages of "scientific" and 
"popular" questions should be tested by using the latter 
with certain sections and the former with others. These 
proposals, however, could not be camed out satisfactorily, 
owing to lack of time. 

The foUowing report on the methods and results of this 
experiment was presented at the joint conference on October 
29, 1913. 

Method and Restdts in an Experiment with Preparatory 
Questions in Certain Sections of Economics Ay i gi 2-1 3 

In Economics A, the assigned reading is given out at the Saturday 
lecture. In the section meetings of the following week (Monday to 
Friday), the reading thus assigned is discussed. Each lecture covers 
the ground of the reading assigned on the previous Saturday. At 
the first section meeting of the week, a twenty-minute test on the 
reading and the lecture of the previous week is given. 

It seemed clear that a list of questions, given out before the as- 
signment of the reading and designed to stimulate the curiosity and 
challenge the interest of students, might make their reading more 
profitable and their comprehension and memory of it and of the lec- 
ture more complete. Such questions would constitute a device to be 
used in preparing the minds of the students for the facts and concep- 
tions presented in the reading and the lecture, and in arousing and 
directing their attention. Professor Day suggested that such ques- 
tions be given out in certain sections and not in others, beginning in 
February, 1913, and that the records of sections with which the ex- 
periment was tried be compared with the records of the control sec- 
tions throughout the spring and on the final examuiation. The 
results presented below show that in most cases the preparatory 
questions were of some profit in the preparation of the weekly papers; 
but the retums from the final examinations are variable and incon- 
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dusive. A few shiftings from section to section late in the second 
half year account for this in part; and the faet that the results in the 
examination differ so markedly from the results in the paper shows 
how sharply examinations and daily work are separated. It will be 
noted, however, that it was only Section M which forged ahead of its 
competing "favored" sections — a faet for whieh we found no ex- 
planation. The general experienee of the two instruetors who used 
these questions was in favor of them, and a number of students ex- 
pressed their interest in the questions and their belief tbat they had 
been helped by them. 

The character of the questions used may be seen from the 
f ollowing examples : 

1. Rents in Harvard Square are lower than on Washington Street 
in Boston. Would you expeet priees for the same artieles to be less 
at Harvard Square? Why or Why not? 

2. Is the existenee of a leisure elass supported from eeonomie 
rent soeially justified? Do you find any valid objeetions to state ap- 
propriation of all sueh rents? 

3. Wherein are rent and monopoly gains alike, wherein different? 

4. The total annual rental of a house and lot is $5000. The value 
of the house is $40,000. Repairs, depreeiation, and insuranee eost 
Siooo yearly. If the eurrent rate of interest on investments of equal 
seeurity is 5 per eent, what is the value of the lot? 

5. Is the spendthrift a publie benefaetor, in that he inereases the 
demand for labor? 

6. What is meant by the " diseoimted marginal produet of labor"? 

7. What is the eause of the deelining birth rate in advaneing 
coimtries? Would this eauise operate under sodalism? 

8. Are the rieh beeoming rieher, and the poor, poorer? 

9. Can tråde imions inerease general wages? 

10. What is meant by "eharging what the traffie will bear"? 
Would you expeet the railroad rate on a ton of eopper to be higher or 
lower than the rate on a ton of eoal? Why does an express eompany 
eharge no more for earrying 25 Ibs. of books than it does for earrying 
the same distance at owner's risk 25 Ibs. of table silver? 

11. Enumerate all the publie service. Industries you can think of. 
WiQ. the distribution of mUk ever beeome a public service industry? 

12. What is unfair competition? Is the following imfair eompeti- 
tion? — To ref use to sell to any retailer who will carry rival lines of 
goods? 
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Professor Day's Sections 



Mid-Year Examination . 

Paper 

(( 

<( 

Average 

Final Examination . . 



Sect. E 

60.4 

68.2* 

68.8 

71.6* 

75-5* 
71.03 

69.9 



Given preparatoiy questions. 



ict. K 


Favorable 
effectof 
Difference Prep. Questions 


65.3 


4.9 




70.9 


2.7 


3.2 


75-9* 


7.1 


2.2 


73.3 


1.7 


3.2 


76.8 


1.3 


3.6 


74.23 


3.2 


2.8 


73.S 


4.6 


.3 



Mr. Burbank's SEcnoNS 



Mid-Year Exammation 
Paper 



Average .... 
Final Examination 



Sect. D 
62.6 
70.1 

58.5 

65.7 
72.6 

69 

73.2 

68.18 

68.04 



Sect. M 

S9.I 

65.5 

56.7 
63.2 

68 

64.7 
68.1 

64.37 
71 



Favorable 
effectof 
Difference Prep. Questions 



3-5 
4.6 

1.8 

2.S 
4.6 

4.3 

3.82 

2.96 



In each case the preparatoiy questions were given to Section D. 

* Unfavorable 



1. 1 

1.7* 
I. ♦ 

i.i 

.8 

1.6 

.32 
6.46* 



Mr. Burbank's Sections 



Mid-Year Examination 
Paper 



Average .... 
Final Examination 



Sect. G 
60.3 

693 

56.7 
69.2 

70.1 

67.S 
72.6 

70.3 
67.96 

67.1S 



Sect. P 

65.3 
70.1 

S8 
68 

73.8 

73.1 
71.8 

69.7 

69.21 

70.44 



In each case the questions were given to Section G. 

* Unfavorable. 



Favorable 
effectof 
Difference Prep. Questions 



5 
.8 

1.3 

1.2 

3-7 
S.6 

.8 

.6 

1.26 
3.29 



4.2 

3.7 
6.2 

1.3 
.6* 

S.8 

5.6 

3.74 
X.71 
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Mr. Buxbank's SEcnoNS 



Mid-Year Examination 
Paper 



Average .... 
Final Examination 



Sect. D 
62.6 
70.1 

58.5 
65.7 
72.6 

69 

73-2 

68.18 

68.04 



Sect. P 

65-3 
70.1 

S8 
68 

73.8 

73.1 
71.8 
69.21 
70.44 



In each case the question was given to Section D. 

* Unfavorable. 



Fayorable 
effectof 
Difference Prep. Questions 



2.7 

•S 

2.5 
Z.2 

4.1 

14 

I.18 

2.4 



2.7 

3.2 

.2 

I-S 

4.1 
1.72 

•3 



Mr. Burbane's SEcnoNs. 



Mid-Year Examination 
Paper 



Average .... 
Final Examination 



Sect. G 
60.3 

693 

56.7 
69.2 

70.1 

67.S 
72.6 

70.3 
67.96 

67.1S 



Sect. M 

S9.I 

65.5 

56.7 

63.2 

68 

64.7 

68.1 

69.2 

65.57 
71 



In each case the question was given to Section G. 

* Unfavorable. 



Fayorable 
effectof 
Difference Prep. Questions 



Z.2 
3.8 

6 

2.1 

2.8 

4.5 
1. 1 

3.38 

3.85 



2.6 

1.2* 
4.8 

.9 

1.6 

S'S 
.1* 

1.7 
5.05* 



Average favorable effect on the papers, 2.81 in 24 cases, 
unfavorable " " « « i. 5 cases, 

favorable " " " final examination, .77 in 3 cases, 
unfavorable " " " " " 5.75 in 2 cases. 






The results of this experiment were not in themselves con- 
vincing as to the advantage of preparatory questions, yet 
they have some weight in corroboration of the general 
observation and opinion of the instructors. The only 
possibility of systematic error in the marking lay in the 
temptation which the instructors might have felt to give 
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higher marks to the students in the sections using prepara- 
tory questions. But the marks on the papers and on the 
final examinations were not given, of course, to the students 
of the various sections as groups, but as individuals, and it 
seems unlikely that any imconscious tendency to mark the 
students of one section higher than those of another could 
have exerted an influence strong enough to overcome 
conscientious effort to assign marks accurately. For the 
comparisons, a broader basis than the average standing of 
sections in the mid-year examinations should have been 
secured; and the preparatory questions should have been 
used for a considerable period with one section and then 
with the other. 

III. Proposals for Expebtmknt m Method 

The first proposal for experiment in method was made 
in February, 1913. Economics A was then concemed with 
the subject Interestj and it was agreed that in one section 
the students should omit reading the passages in the text 
and instead look over the financial sheet of the morning 
paper to find the rate of interest and what quotations give 
the dearest indication of it. On the basis of this more or 
less practical contact with the facts of the matter, discussion 
was to bring out the principles necessary for a completer 
understanding of the topic. In another section the usual 
procedure was to be foUowed, and the performances of the 
two sections on the subsequent class paper were to be 
compared. The more inductive procedure, starting from 
the study of facts presented in a way already partly f amiliar 
to most of the students, might, it was thought, yield better 
results by arousing greater interest and attention. The 
results of this experiment were to be combined with the 
results of similar experiments with inductive teaching, in 
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each case a "contxol" section giving the necessary basis 
for comparison. Unf ortiinately, a mistake in the assignment 
of the work made it impossible to compare the performances 
of the two sections on Interesty and the experiment with 
preliminary questions took most of the time we could give 
to this phase of the investigation thereaf ter. 

The next fall, however, an attempt was made to conduct 
an experiment in the leaming of a set definition. At a 
conference of instructors and assistants in Economics A, it 
was agreed that three of the men in charge of sections should 
attempt an experimental determination of the value of the 
careful leaming of a fixed definition, Each of these in- 
structors agreed to teach the definition of Marginal Utility 
in certam sections and not in others. The procedure agreed 
upon was as foUows: The general conception was to be 
discussed in class in the usual fashion by question and 
answer, but before the close of the hour the instructor was 
to ask for the definition of Marginal Utility ^ and this was 
to be put on the board, The definition as given was to be 
criticized and corrected and the definition agreed on by 
the instructors was to be substituted on the board for any 
less adequate definition suggested by the students. The 
definition as prsented by the instructors was to be leamed 
by heart by the students and their exact recall of it tested 
in a subsequent section meeting, The advantage of this 
procedure was to be compared with the advantage of teach- 
ing this topic without the leaming of a set definition, by 
means of a question to be answered in the fall hour-examina- 
tion. This experiment failed because the instructors did 
not succeed in saving timte enough for the teaching of the 
definition, Only one found himself in a position even to 
report his results. 

Experiment in college teaching demands a great deal of 
time and close attention to detail, There are so many 
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possibilities of error, means of control are so difl&cult to 
apply, and conclusive tests so hard to devise, that some 
experience, to say nothing of time, energy, and purpose, is 
necessary to carry an experiment to a profitable conclusion. 
We believe this can be done, however, and that in many 
cases in which the value of a particular method is in dispute 
it would pay to attempt it. There is no good ground, to be 
sure, for the hope that experiment in this field can be made 
so exact as to banish forever all possibility of difference of 
opinion. The complexity of the action to be controUed, 
the impossibUity of eliminating hiddeh factors, and the 
barriers to observation of results are aU such as to make 
dubious the expectation of final conclusions based solely on 
experiment. Yet the effort to secure returns more exact than 
those of unrecorded and unchecked observation cannot but 
yield a valuable result. It wiU at any rate sharpen observa- 
tion and concentrate attention on problems of teaching 
which are now too often entirely ignored. It is evident 
that the arrangement of sections in Economics A offers a 
particularly good opportxmity for exact comparison of the 
results of different modes of procedure in the class room. 
Many of the policies and devices contained in the list of 
Section II of the chapter on Method might be tested by 
controlled experiment in these sections. We would suggest 
as especially profitable fieids for experiment in method the 
f ollowing : 

(i) The use of devices other than preparatory questions 
for arousing interest and curiosity in advance of class dis- 
cussion, reading, or the lecture on a given topic. Discussion 
in class and the assignment of reading in current newspapers 
and magazines might bring even better results than the use 
of printed questions. 

(2) The presentation in class of the materials and at 
least the beginning of the process of memorizing them imder 
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the direction of the instructor, in cases where figures, graphs, 
terms, etc, are to be leamed from visual impressions. 

(3) The use of reports from students, brief debates, 
questions and problems framed by the students, and other 
devices for securing participation by the class as a means 
of assuring complete imderstanding of a generalization, 
principle, or complex situation, with which the dass should 
be made thoroughly familiar. 

(4) The use of at least one practical project or investiga- 
tion of considerable extent in the course of the year as a 
means of giving to students a fuller imderstanding of the 
nature of economic facts and principles. 

rv. Proposal for a Fundamental Test 

One of the first proposals of the Inspection was the 
formulation of a general test by which growth in ability to 
handle economic data and solve economic problems might 
be measured. It seemed to us not impossible to secure a 
set of questions, or better still, several alternative sets, 
comprehensive enough to cover most of the main fieids of 
economic inquiry and difl&ciilt enough to test the ability of 
advanced students, yet presenting problems of such common 
interest and general importance that even the beginner 
might attack them with some measure of comprehension, 
Such a set of questions could not be used, of course, as an 
ordinary examination, since the answers to them might be 
leamed in advance if it were known that they were to be 
given more than once, A test of this sort would be useful 
only as a measure of the increase of general ability in the 
subject resulting from any given amoimt of study of eco- 
nomics or any particular phase of it. It would be essentially 
an instnmaent of investigation. 

Obviously, the questions to be used in such a test would 
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have to be tried first in section meetings or examinations in 
several of the conrses in order to discover their availabil- 
ity for this particular purpose. Questions which could be 
answered with complete success by a large proportion of the 
students at the end of the introductory course would not be 
snitable, nor would questions too difl&cult even for relatively 
advanced students. Questions to which the answers would 
necessarily be overlong and hard to grade would not do; 
for an essential requirement of the test would be that retums 
from it could be graded with considerable accuracy. For 
this reason, and also for the obviously necessary purpose of 
excluding problems on which economists are stiU too largely 
in doubt, it would be necessary to exclude questions which 
could not be carefully analyzed for the accurate grading of 
answers. These requirements make the formulation of a 
fimdamental test a time-consimiing and difl&cult task. We 
could not delay the other phases of the Inspection in order to 
secure a large nimiber of questions and to prove their value 
for this purpose. In consequence, only one question was 
tested by giving it in a section meeting in Economics A and 
again in the final examination. Professor Day, however, 
handed in a nimiber of questions which he considered 
promising for use in the test, and some of these are presented 
here, together with the results of the two examinations in 
Economics A, on which the first question was set. 

The character of the questions submitted by Professor 
Day as possibly suitable for a fundamental test may be seen 
from the f ollowing examples : 

1. To what extent and in what manner do the f ollowing contribute 
to the fomiation of capital: a miser; a postal savings bank; a life in- 
surance company; goverament borrowing; a maniial training school 
teacher; a college professor? 

2. In what respects is the wide extension of the corporate organiza- 
tion of industry advantageous, in what respects disadvantageous, for 
(a) the business man? (() the investor? (c) the community at large? 
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3. What party if any, do commerdal banks play in (a) the process 
of investment? (() the increase of capital? (c) tiie course of industrial 
development? (d) leadership in the business world? In what respects 
may the influence of commercial banks be undesirable? 

4. By what process, if at all, should you expect the following to 
influence the general price level in the United States: (a) advertising; 
(() the growth of the trusts; (c) increasing demands of trade-unions; 
(d) extravagant purchases of automobiles; (e) increased output from 
South African gold mines; (f) wider use of deposit accounts in France? 

5. Explain the parts played in the coiurse of industrial crises and 
depressions by (a) distributing middlemen; (b) financial middlemen; 
(c) the accimiulation of fresh savings; (d) extensive crop failures; 
{e) an increasing gold supply; (/) the failiu-e of an important indus- 
trial incorporation; (g) an extension of govemment interference with 
the conduct of business. 

6. In the case of urban sites, what are the arguments for and 
against state appropriation of (a) all economic rent? (b) all futiu-e 
increases of economic rent? (c) part of futiu'e increases of economic 
rent? 

7. Should taxation be used as an instrument for (a) appropriating 
illegitimate incomes? (b) restricting undesirable business practices? 
(c) absorbing monopoly profits? (d) reducing inequalities of wealth? 

For what other objects may taxation be employed? 

8. Give the argimients (a) from the viewpoint of the trade-unionist, 
(b) from the viewpoint of the economist, for and against 

1. the closed shop; 8. a standard rate of wages; 

2. the open shop; 9. semi-militarydisdpUnebyem- 

3. the closed union; ployers; 

4. the open union; 10. the"scab"; 

5. labor-saving appliances; 11." the strike; 

6. limitation of output; 12. the lockout. 

7. piece-work; 

9. How is industrial leadership affected by (a) the diffusion of 
education? (6) freedom of opportunity? (c) inequality of possessions? 
{d) immaterial rewards? 

10. Upon what grounds, if any, are the following to be condemned 
or justified: (a) the right of inheritance; (() the institution of pri- 
vate property; (c) the leisure dass? 

The question set in the regular class meeting of Economics 
A for October 18, 1913, and repeated on the final examination 
in Jime, 1914, was as foUows: "*The principle of protection 
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is to build up our home Industries by manufacturing our 
own products. This gives our people employment, keeps 
the money in the coimtry, and makes this coimtry an inde- 
pendent and self-reliant nation.' Wherein are these argu- 
ments valid? Wherein invalid? Give your reasons." 

The answers to the question were to be graded accord- 
ing to the following analysis of the elements a correct 
answer was expected to contain. 



Analysis 

Question parts: 

1. The prmdple of protec- 

tion is to build up oiu- 
home industries by 
manufactiuing our 
own products. 

2. This gives our people 

employment. 



3. Keeps money in the 
country. 



FOR Grading Answers 

Weight 
Answer parts : given : 

1. Theprindpleofprotectionnot .02 J^ 

necessaiily confined to man- 
ufactiu-e. May apply to 
agricultiu-e, for example. 

2. Protection does not increase .30 

employment, but simply 
changes the direction of 
industry. 

3a. This involves the falladous .20 
notion that all importations 
are paid for in money. Of 
course only international 
balances are settled in 
spede. 

(. High protection may cause a .023^ 
somewhat greater share of 
the world's monetary stock 
to remain in the country. 

c. The statement implies that .12}^ 
money is peculiarly desir- 
able or in a spedal sense 
"wealth." This, of course, . 
is erroneous. A large stock 
of money is, in general, no 
gain; it simply means the 
use of a greater number of 
coimters. 
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d. There may be a slight gain, .03|^ 
however, in the purchase of 
foreign conunodities pro- 
duced on a lower price 
level. 

4- And makes this country 4a. Sdf-suffidoicy is no more .35 



an independent and 
self-reliant nation. 



an economic goal among 
nations than among indi- 
viduals. Division of tabor 
is desirable, for it leads to 
the adaptation of industry 
to econtxnic advantage. la 
other words, nations wiU 
ptoduce those conunodities 
in the production of which 
they have the greatest com- 
parative advantage. 
h. Military self-suffidency may .05 
perhaps be justified on polit- 
icai grounds. 

One hundred and twenty-two answers to this question 
on the papers written in October were carefully corrected 
according to the above analysis by the staif of Economics 
A and the grades given are compared below with the grades 
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received by the same men on this ideiltii^.question in the 

• • o 

final examination in Jime, 1914. 

• • • 

The table shows, as might be expected, a genecaj. shif ting 
toward the higher ranks; but it shows also that thé.^uesjtion 
thus tested would be fully available for such a Kst ^B was 
proposed. The question proved difl&cult for beginners, yét^^ 
not too difficult, since 61 per cent of the October answeréf 
could be graded 10 or above. It also proved sufficiently diffi- 
cnlt for the majority at the end of the year, for almost half 
(57) of the men received a final grade lower than 60. In 
continuation of this experiment it would be interesting to 
give the same question to students in higher courses in the 
Department, both during the fall and at the end of the 
year. 

V. Examination Questions 

According to the statements made by the instructors of 
the Department, which for convenience of reference are 
summarized below,^ two clearly defined aims characterize 

1 Instructor 

B . . To think clearly, and form a rational conclusion; development of the 
power to analyze ... to orient oneself, and keep one's bearing in the 
midst of the varying winds of doctrine; to reason consecutively. 

F . . I. Training in assimilation of facts (to put men in possession of the 
principal facts). 
2. Training in critical analysis, 

G . . I. Survey of the subject at large (information). 

2. Train men in thinking and reasoning (independeni tkinking), 

3. Better dtizens. 

4. Training in investigation (advanced course). 

£ . . Perspective and background through information (historical course), 

and in addition, questions which develop power of rdaUng information. 
D . . Analysis of materials, methods of presentation; acquaintances with 

courses. 

To weigh carefully; reason cogently; more capadty for comprehension 

and analysis. 

To teach students to analyze. 
C . . "To cultivate by practice the analytical faculty and judgment." 

To consider "analytically a faet so as to find out its elements or its 
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practically eyej^-Vourse in the Economics Department: 
(i) the impaKing of a certain amount or sort of information; 
(2) trajiiii^.'in the ability to analyze, to relate facts, and to 
rea^on.** . By some it is implied that this is a general training, 
but fpr the most part it is specified that the training is in 

.•/^tjtfdling the particular body of facts presented in the course. 

/ ';*• In addition, a third aim is assigned in some of the advanced 
courses, — namely, training and guidance in independent 
thinking and investigation. There are one or two other 
aims stated, as for example, that of preparation for citizen- 
ship. 

The examination questions given in these courses offer 
one way of estimating in how far their aims are actually 
realized. If it is intended to train students in reasoning, 
for example, the examination questions should be tests of 
their ability to reason. They should demand not simply a 
memory of how others have reasoned about these situations, 
but actual independent reasoning and thinking. With this 
question in mind, the examination papers in the various 
courses were inspected to determine what proportion of 
the questions in the examination papers caU for information, 
and what proportion demand specificaUy analysis and 
reasoning. 

The questions have been divided roughly into two 
classes, — "memory" questions and "reasoning" questions. 

significance, and the relation of the discovered faet to other facts 
either obvious or derived." 

''Memory plays ahnost no part in the work. Only analysis and judg- 
ment will accomplish anything." 
To cultivate the power to analyze a business situation. 
A . . General knowledge of prindples and their applications, and the real 
meanings of the study. 

As much knowledge as possible of prindples and the application and to 
Train students in methods of investigation and reasoning ... to get 
men to think for themselves. 
Acquaintance with literature. 
"To impart information, to teadi men to think and to investigate." 
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"Memory" questions were considered to be those that 
involved merely a statement of faet or opinion evidently 
developed in lectures, reqnired reading, or sections. "Rea- 
soning" questions involved expressions of opinion on the 
part of the student, organization of data in the examination 
room, analysis of new situations, and relating information 
to economic theory. 

Some of the questions classified imder "reasoning" doubt- 
less demand simply memory of reasoning done in class or by 
the instructor, and probably others demand merely the 
memory of a formula, the rest being the somewhat mechani- 
cal application of it; but it would not be possible to decide 
in these cases without a very intimate knowledge of the 
courses in question. On this accoimt there is doubtless more 
"memory" work demanded on the examinations than the 
results reported below would indicate. 

Ten examples of questions which were considered to call 
primarily for memory and ten which were considered to call 
for reasoning are Usted below.^ 

^ "Memory" Questions 

1. "The standard of living afifects wages not directly, but" — how? 

What evidence of varying standards of living appears in the statistics of births 
and deaths for different countries? for different social dasses? 

2. Under what conditions does inconvertible paper money drculate as readily 
as specie? Under what conditions, not as readily? 

Under what conditions is the value of inconvertible paper money as great as 
that of specie? Under what conditions is its value less than that of specie? 

State two indications of its having less value than specie. Which of the two 
is the more significant? Which is the more easily ascertained? 

3. State points of similarity, points of difference, between the Federal Reserve 
system and the English banking system as regards (a) centralization of reserves; 
(6) centralization of note issue; (c) measures available for preventing panics. 

4. (a) How was the capital for the construction of railroads prior to 1870 
obtained in the different European countries? Why? 

(b) Why was the railroad policy of Prussia modified after 1870? With what 
results? 

5. Compare the English and Belgian methods of relieving the recent agricul- 
tural depression. 
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Fifty-one examinations, both mid-year and final, set in 
the foUowing courses dnring the years 1912-1913, 1913- 

6. Give an account of the main developments in the London money-market 
from the outbreak of the War until the end of February, 1915. 

7. Explain: ''puts''; "borrowing and canying"; stock-ezchange clearing 
house. Discuss the relations of the Stock Exchange and the bahks in New York. 

8. Compare the views of Mill and Ross as to the limits of social control. 

9. What, according to Ross, is the relation of resentment to social worker? 

10. What is sabotage? 

"Reasoning" Questions 

1. Construct a simple index number of prices for 1914, using 1908 as the base. 
(A) Would the index-number point to a rise or a fall in the value of money? (B) 
Would a Board of Arbitration be justified in recommending a change in wages? 
If so, on what basis? If not, why not? 

2. Explain briefly the immediate and the ultimate effects (if any) which each 
of the foUowing changes, taken separately, will tend to have on the price of cotton, 
cotton-seed oil, and cotton-mill machinery; (a) prohibition of organized specula- 
tion; (6) a change of fashion toward greater use of cotton fabrics; {c) doubling 
of the population of the country. (Assume for all three cases that there is no 
international tråde, and that the quantity of money remains the same.) 

3. In what direction and by what process, if at all, would the following tend 
to afifect the value of money in the United States: (a) increased demand for gold 
ornaments; (b) increasing lavish expenditures by spendthrifts; (c) a continued 
drain of specie to the East; (J) a larger output of silver in the United States; 
(e) abolition of all legally required banking reserves? 

4. OutUne briefly your views as to the immediate influence of the Civil War 
on (a) land policy, (b) banking, (c) tariff, and (d) industrial progress North and 
South. 

5. "Surpluses have spelled disaster to the United States." Do you agree? 
When and how? 

6. Assuming the laws of the United States to remain unchanged, how would 

our monetary stock be affected if the market ratio of gold and silver should be- 
come 18 to i; 15 to i; 12 to i? 

7. In Austria, "af ter 1870, — the value of paper money with respect to silver 
steadily rose until, in 1878, it reached parity with silver ... In 1879, the free 
or private coinage of silver was stopped." Consider whether, after this action, 
the (i) silver pieces, and (2) the paper notes were conmodity, credit, or flat 
money? Had Austria not dosed the mints to the free coinage of silver, how would 
the following have been affected in that country: (a) the monetary stock; (6) the 
monetary standard; {c) the value of money? 

8. Explain or illustrate exactly what you understand by self-interest. 

9. Outline a program for raising the wages of all the lower grades of labor. 

10. Would the following appear on the income sheet or on the balance sheet? 
Under what name in either case? 
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1914, and 1914-1915, were induded in the study: A, i, la, 
2a, 2b, 3, 4a, 4b, s, 6a, 7, 8, 9, II, 12, 13, 14, 24, 31, 32, 33. 
The results were as f oUows (in percentages) : 



Instnictor 


Coune 


"Memory" Questions 


"Reasoning" Questions 


G 


a 


12 


88 




b 


17 


83 




a 


38 


62 


B 


b 


7 


93 




c 


62 


38 




a 


68 


32 




b 


67 


33 


F 


c 


63 


37 




d 


67 


33 




a 


80 


20 


E 


b 


74 


26 




c 


SS 


45 




a 


25 


75 


D 


b 


87 


13 




c 


100 





C 


a 





100 




a 


53 


47 


A 


b 


78 


22 




c 


60 


40 



The above table gives the proportions in the final examina- 
tions only. Certain mid-year papers were also examined 
as f ollows (in percentages) : 



Memoiy 
Questions 


Reasoning 
Questions 


Total ofMid-Year 

and Final 

Memoiy Reasoning 


46 


54 


48 


Sa 


55 


45 


46 


54 


17 


84 


31 


69 



Instructor G . . . . 
Instructor D , , , , 
Instructor A , , , , 

Conclusion: There are discrepancies here and there 
between the statement of the aims of the instructors and 

(a) Cost of a patent bought. 

(b) Rent for storage of new machinery ordered from different finns and de- 
livered at different times, but to be installed together, as soon as all arrives, 
in a new shop. 

(c) Author's royalty on a copynghted story printed and distributed in an ex- 
tended advertising campaign. 

(d) Cost of heating during permanent interior decoration of a new store. 
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the evidence fumished in the examination questions. The 
latter, of course, do not provide an altogether sufficient 
criterion on which to judge, but it is to be noted that, in the 
main, there is agreement between the statement of aims 
of the instructors and the kind of questions set in the 
examination papers. This is notably so in the case of 
Instractor C. 



CHAPTER V 

THE QUESTIONNAIRES 

I. CONSTRUCTION OF THE QUESTIONNAIRES 

DuRiNG the fall of 1914 provisional questionnaires to 
graduatesand to students weredrawn up and submitted to the 
Department of Economics. A joint committee later put these 
questionnaires into final form, and they were sent to alimmi 
in February 19 15 and given out in classes early in March. 
The questionnaires read as f oUows, the larger printed form 
allowing ample room for replies: 

I. Qtiestionnaire to graduates 

Ha&vasd University 

Division of Educaiion — Department of Economics 

Dear Sir: 

The Department of Economics has invited the Division of Educa- 
tion to investigate the midergraduate instruction in Economics with 
a view to its improvement. This set of questions is sent out by the 
Division of Education with the approval of the Department of Eco- 
nomics. The Department of Economics joins the Division of Educa- 
tion in requesting that you give the questions your careful attention 
and mail this sheet in the endosed envelope by March — . Your 
answers will be received by the Division of Education and will be 
treated as confidential by that Division if you so desire. 

Yours truly, 

The Department of Economics, 
The Division of Education. 

1. Name. Class 

2. Address. 

3. Occupation. 

107 
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4. On the following page, please list the courses in Economics 
you took at Harvard and make some statement conceming 
their subsequent value to you. Have the courses proved 
valuable (a) in your vocation, and if so, in what way? 
(6) in your social, civic, or economic activities outside your 
vocation, and if so, in what way? {c) in other, more general 
phases of your life, and if so, in what way? Please feel free 
to make your statement in your own terms; if you cannot 
spedfy as to courses, but can make a general statement con- 
ceming your work in Economics as a whole, please do so. 

Courses Year Statements 



5. Can you ascribe any of these values to a particular part or re- 

quirement of a course — as, for example, to a certain book 
assigned, lectures on a particular topic, a particular method 
of presentation or of study , or a particular thesis requirement? 

6. In what way would a different treatment of any of these courses, 

either as to subject matter or as to method, have made it 
more valuable to you? 

7. Is there any aspect or field of Economics which you now wish 

you had studied in college? Please indicate, in particular, 
such subjects as you desired to study in college but did not 
find offered in the progranmie of the Department. 

8. What suggestions or critidsms, general or spedfic, have you to 

ofifer? 

2. Questionnaire to students 

Ha&vahd University 

Division of Education — Department of Economics 

The information cailed for below is desired in order that the courses 
in the Department of Economics may as far as possible meet theneeds 
of the students. You are requested to give the data cailed for as fully 
as you are able. Your answers will be received by the Division of 
Education, and will be treated as confidential by that Division. The 
answers vnUl not be shown to instructors in Economics without the 
permission of the writers. 
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Please mail this sheet in the accompanying envelope not later than 
March cx>. 

1. Name. 

2. Address. 

3. Candidate for what degree? 

4. Class? Underline: 1915, 1916, 1917, 1918. 
Graduate School of Axts and Sciences? Year. 
Graduate School of Business Administxation? Year. 

5. Indicate the courses you have completed in the Department 

of Economics: 



Course 



Year 



Grade 



Course 



Year 



• • • • 



Grade 



6. What courses are you now taking in Economics? Do you in- 

tend to take others? 

7. What is your field of concentration? 

8. In what field, if any, are you a candidate for the A.B. with 

distinction? 

9. What is to be your vocation after graduation? 

Do you expect your study of Economics to help you in that 
vocation? How? 

10. What are your general reasons for stud3dng Economics? 
What were your specific reasons for choosing particular courses? 
On what information and advice, if any, did you select your 

courses in Economics? 

11. What courses in the Univérsity, outside the Department of 

Economics, have you found most helpful in your study of 
Economics? Why? 

12. What diflSculties have you met in your study of Economics? 
Please reply frankly and spedfically, indicating any lack of 

fadlities, disadvantageous arrangement of requirements in 
reading or thesis writing, lack of supervision in your work, 
or other obstade to progress. 
If you have found any course disappointing, please name 
it and tell why, in your opinion, it did not meet your 
needs. 

13. Mark in order (i, 2, etc.) the following phases of the work 

according to their relative helpfulness to you, b^ginning 
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with the most helpful: lectures; dass discussions; assigned 
reading; reports; essay writing; laboratory exercises; com- 
ments or additional information. 

14. Do you find your instruction in Economics related to the 

problems you meet in life? How? 
Åre you interested in any particular movement or problem of 
theday? What? 

15. What added suggestions or critidsms, general or spedfic, have 

you to ofifer? 

The repUes were satisfactory in number and almost 
without exception carefxil and serious in character. Since 
the value of any answer, criticism, or suggestion made in 
response to a questionnaire depends very largely on the 
eamestness, standing, and character of the one who responds, 
it seemed best not to try on most of the points to secure data 
which could be håndled statistically. Counting votes is 
not an especially profitable way in which to secure guidance 
in dealing with a technical problem. The drift of opinion, 
however, was in this case, as it is in others, worth knowing, 
and the summaries given bdow show the drift of opinion on 
a munber of important matters. Yet if any suggestion or 
criticism is to be assessed at its proper value, the records of 
the men who make it must be known; and for this purpose 
(since it was obviously necessary to promise that the replies 
themselves should be received in confidence) the data from 
all the replies were entered on large sheets so that anyone 
interested might f ollow any reply across the various columns, 
get its general tenor, discover the courses taken and grades 
eamed by the individual thus responiling, and such other 
pertinent facts as his vocational purpose, or his reasons for 
taking courses in Economics. 

The criticisms and suggestions from alimmi conceming 
particular courses were recorded on a special set of cards and 
specific mention of individual instructors on a separate 
^eet. T^ese special data and the large sheets mentioned 
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above are in the hånds of the Department of Economics.^ 
This chapter deals solely with questions of some general 
importance. 

II. The Returns 

A. Replies from Alumni 

1. The number of replies received was 330, out of a possible 
thousand — a proportion reasonably gratifying in view of 
the somewhat formidable character of the questionnaire, 
and a total quite sufficient for safety in drawing conclusions, 
Twelve of the replies were not included in maJdng the siun- 
maries which f oUow, either becanse the writers had taken no 
courses in Economics or because their answers were not 
pertinent. The simmiaries are based, therefore, on 318 
replies. 

2. The dasses in which the men were grouped ranged 
from 1880 to 1913, as foUows: 

Class Number of Men Class Number of Men 
1880 I 1904 4 

1890 3 1905 26 

1891 42 1906 24 

1893 I 1907 16 

1894 13 1908 3 

1896 II 1909 18 

1897 I 1910 9 

1899 9 1911 31 

1900 I 1913 25 

1901 13 1913 20 

1903 60 

Total 318 

3. The standing in the community of some of the writers 
was suggested by the faet that their names were foimd in 

^ In order to secuie data on spedfic oouises now (1916-17) actually in opera- 
tion, the Department of Economics has issued a seoond questionnaire to imder- 
graduates, framed in light of our experience with the questionnaires here discussed. 
The returns from this second list of questions are available, and so far as they are 
of general interest may be secured from the Department. 
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"Who's Who in America" for 1914-15. Seventeen of the 
318 writers were included in the records of this publication. 

4. The degrees recdved by the writers axe shown in the 
following list: 

Baccalaureate Degrees 

A.B 308 

A.B. without distinction 158 

A.B. cum laude 87 

A.B. magna cum laude 52 

A.B. summa cum laude 11 150 

S.B 10 

Higher Degrees 

A.M 56 

Ph.D 21 

L.H.D I 

M.D IS 

LL.B 71 

M.E I 

M.E.E 3 

S.T.B 6 

S.T.D I 

M.F 3 

M.BA 2 

Mus.B I 

The group as a whole is therefore highly respectable, 
academically speaking. 

5. The occupations of the writers are shown in the foUow- 
ing table. There is a slight overlapping due to the faet that 
a few men gave more than one occupation. 

Older Professions 

Thelaw 74 

Teaching 46 

Medierne 15 

Theministiy 7 

142 
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Technologicai Professions 

Engineering 11 

Naval engineering i 

Mining geology i 

Forestry i 

Chemistry 3 

Architecture S 

22 
Business 

Manufacturing 18 

Management 9 

Fiduciary positions 12 

Banking and brokerage 22 

Real estate and insurance 8 

General commerce 13 

Advertising 3 

Publishing 4 

Transportation 3 

Bookkeeping 3 

Buying, selling 6 

Unclassified i 

102 
Agricidture, etc. 

Farming 8 

Horticulture i 

9 
Journalism 

Newspaper or magazine work 8 

Other Occupations 

Art 2 

Study 16 

Secretarial work 6 

Statistics 3 

Public service 5 

Scientic work 3 

Not given 7 

6. The courses in Economics taken by the writers appear 
in the following list: 
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Economics I (now A) only 82 

Eænomics I and other courses 232 

Other courses only 4 

Middle-group courses 175 

Upper-group courses 21 

Undassified 38 

7. The values assigned to instruction in Economics are: 

(a) VocaUonal values found by 135 men 

(b) Social and civic values found by 84 " 

{c) General values found by 205 '' 

The retums on this point are considered in greater detail 
below. 

8. The parts of the work which the men mentioned favor- 
ably or unf avorably were : 

(a) LectureSf of which 31 men speak f avorably 

although 9 men speak imf avorably 

(b) SecHon meetings , of which 20 men speak f avorably 

although 20 men speak imf avorably 

(c) Theses, of which 33 men speak f avorably 

although 4 men speak imfavorably 

9. The methods singled out for special mention by more 
than one man were: 

(a) The method employed by Professor Taussig in Economics 2 

This method is variously referred to as the Socratic, the quiz, and the 
class discussion method. It is spedfically and favorably mentioned by 
II men. 

(b) The method employed by Professor Garver in Economics 3. 

This method is referred to as the discussion method and is favorably 
mentioned by 6 men, although i other did not find it in^iring. 

Case and class discussion methods are mentioned favor- 
ably, but not in connection with any particular course, by 
10 men. One man, however, considers the case method 
unsuited to undergraduates. Sixteen men speak favorably, 
in a general way, of quizzes or of other ways in which 
participation by students in class work may be secured. 
Many insist on small classes and personal contact with the 
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professor. Four lay stxess on the great advantage of thesis 
work. Of two others who speak favorably of theses, one 
thinks they shoxild be required often and short; whereas 
the other woxild reqiiire only few theses, on the ground that 
their preparation demands much time and attention. One 
man wonld require a thesis in Economics A. Three speak 
favorably of the written tests and papers. 

10. The assistants are mentioned as foUows: 

Favorably by 7 men 

Unf avorably by 31 " 

Other replies which cover section meetings and the work 
of assistants together are smnmarized more completely 
below. 

11. The courses men wish they had taken were: 

1. Accounting 20 men 

2. Banking 19 

3. Sodology 12 

4. Business Administration 12 

5. Transportation 10 

6. Labor Problems 8 

7. Foreign Exchange 6 

8. Commerdal Law 5 

9. Economics of Agriculture 3 

10. Foreign Tråde 3 

11. Financial Crises 3 

12. Tarifif 2 

13. Statistics 2 

12. Suggestions and criticisms were offered by a large 
proportion of the writers, and may be smnmarized in part as 
f ollows : 

a. Lack of practical application was mentioned so many 
times that it must be listed as a major criticism. 

In all, this criticism is made or directly implied by 63 men 

The opposite view was held by i man 

Further analysis of the suggestions imder this head is 
made in a later part of this Section. 
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Specific suggestions were: 

1. More frequent reference to current events suggested by ... . 30 men 

2. Gloser study of labor unions suggested by 6 " 

3. Fuller training in elementary bookkeeping as a preparation for 

the course in Accounting suggested by 5 " 

4. The study of modem sociologicai problems suggested by . . . 2 " 

5. Visits to Boston banks suggested by 2 '* 

6. Lectures by successful business men on their spedalties .... 2 " 

7. Admission of undergraduates to courses in the Business School 
suggested by 2 " 

8. The study of stock exchange methods suggested by i man 

9. Investigation of actual business methods suggested by ... . i " 
10. The study of investments suggested by i " 

b. Miscellaneous suggestions and comments may be listed 
as f ollows : 

1. Greater opportimity for contact with professors suggested by 6 men 

2. More general courses in Economics at the expense of specialized 
courses suggested by 5 " 

3. The treatment of economic theories as less fixed than has hereto- 

fore been the custom suggested by 4 " 

4. Diminution of memory work in favor of development of thought 
suggested by 4 " 

5. Fuller guidance in the selection of courses suggested by ... . 3 '^ 

6. Making some study of Economics compulsory suggested by . . 3 '' 

7. Provision for direct practical training for definite work suggested 

by 2 " 

8. The teaching of methods rather than facts suggested by ... . 2 " 

9. Vocational guidance in college suggested by 2 '' 

10. Requirement of more written work suggested by 2 " 

11. More collateral reading suggested by 2 " 

12. More careful selection of reading and better correlation with the 
lectures suggested by 2 " 

13. Gloser correlation of section meetings and lectures suggested by i man 

Strong commendation of courses in Economics and the 
methods of instruction in vogue in the Department is not 
infrequent, and most of the answers imply satisfaction with 
the instruction in one way or another. Eight men speak in 
especially high terms of the courses given during their time. 

13. On the values assigned to the instruction, to section- 
meetings and assistants, and to the practical applications of 
the instruction, more elaborate analyses were made. 
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The Valtce of Economics Cour ses to Lawyers and Jtulges 

Of this group 18 took Economics i only, 12 took two 
courses, and 42 took three or more courses. Nineteen were 
graduated before 1900, 36 between 1899 and 1908, and 27 
from 1908 to 1913, inclusive. 

Value in Vocation 

Number Per Cent 

Number of replies considered 72 — 

Decidedly advantageous in vocation . . 7 10 
Favorable comment, moderate or uncer- 

tain statements 21 29 

Vigorous adverse æmment 2 3 

Adverse, less vigorous æmment .... 3 4 

Totals: Advantageous 28 39 

Of slight value if any .... 5 7 

No æmment 39 54 

Social or Civic Value 

Number Per Cent 

Number of replies considered 72 — 

Decidedly helpful in these respects. . . 6 8 
Favorable comment, moderate or uncer- 

tain statements 13 18 

Vigorous adverse comment 3 4 

Adverse, less vigorous comment .... 2 3 

Totals: Courses helpful 19 26 

Of slight value if any .... $ 7 

No comment 48 67 

General Ctdtural Valnes 

Number Per Cent 

Number of replies considered 72 — 

Decidedly helpful in these respects. . . 9 13 
Favorable comment, moderate or uncer- 

tain statements 41 57 

Adverse comment i z 

Totals: Favorable comment .... 50 70 

Adverse comment z z 

No comment 21 29 
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Various Values Mentioned in Different Replies 

A considerable number stated directly or implied by their 
answers that it was difficult to name specific values which 
had residted from the courses taken. They felt that they 
had been helped in various ways but were imable to discover 
tangible results or give concrete examples. Fourteen (20 
per cent) made definite statements to this effect. 

Eighteen (25 per cent) thought that they had been helped 
m fonning their opinions on current questions aside from 
politicai issues. Nine (13 per cent) were better able to 
decide political questions. 

Mental discipline or general training of the mind is evi- 
dently considered an important result by many of this 
group. Eleven (16 per cent) make explicit mention of this 
point. 

Eight (11 per cent) had formed habits of logicai thought 
and careful investigation which were of assistance in their 
law practice. The method of Economics 2 was often 
alluded to as being especially valuable in this particular. 
Accoimting was regarded by 7 (10 per cent) as being a 
subject which had proved of practical value in keeping their 
own accoimts and in understanding the cases with which 
they dealt. Three (4 per cent) regarded the study of 
banking as having similar values. One spoke of the course 
in transportation as having been of practical assistance. 
Four (6 per cent) had a better understanding of busi- 
ness and corporate matters by reason of having taken 
Economics courses. 

Nine (13 per cent) regarded the courses taken as being 
a valuable introduction to the field of economics, and 7 
(10 per cent) were stimulated to do further private reading 
and study. Four (7 per cent) spoke of the courses as 
having "cultural" value. Three (4 per cent) mentioned 
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being better able to understand matters about which they 
read in newspapers or magazines. Three (4 per cent) had 
been stimnlated to think more thoroughly on all subjects. 
Three others were able to converse more intelligently on 
economic subjects. Two felt that they were better able to 
grasp the work of the law school. One regarded the subject 
matter as "valueless" but had received some benefit m 
other ways. 

Quotations from Lawyers on Valtæs of Courses in Vocation 

The degree granted from Harvard or other universities is 
noted in each case. If some special office is held, mention is 
made of the faet. Niunbers refer to courses taken. 

No. 16. A.B. (magna cum laude) LL.B. A.M. Class of 
1 89 1. Economics i and two others. Judge of Juvenile 
Court. 

I cannot say that any of these courses have been of direct 
value to me in my vocation or in my social, dvic, or economic 
activities, but I consider all my work under Professor Taussig 
of great value to me in making up my mind as a voter on eco- 
nomic issues, and in my general imderstanding of the social 
order and the essence of wealth, the real function and nature of 
money, and the relation between capital and labor. 

No. 56. A.B. A.M. Class of 1891. Economics i and 2. 
Department of Agriculture, Washington, D. C. 

The chief benefit I got, espedally from the study of economic 
theories, was the mental discipline. I also received some in- 
delible impressions which have ever since afiFected my point of 
view and method of approaching economic and public ques- 
tions. . . . Except for the past two years, I have engaged con- 
tinuously since 1894 in the general practice of law. It is only 
fair to say that one engaged in sudi an occupation is apt, at 
some time, to find use for every type of information; this is as 
true of one who devotes himself largely to giving advice to 
clients as of one who partidpates much in the trial of litigated 
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cases. . . . My contact with Mr. Brooks and my studies 
under him have, I feel sure, given me a much more sympathetic 
attitude toward social questions, such as general unrest, labor 
unions, and cooperation, than I would have had otherwise. . . . 
I can still hear Mr. Taussig talking and promoting controversy 
and discussion. I am sure that I was aided in my power of 
analysis, in the development of my capacity to weigh evidence 
and to balance off argmnents, and in the growth not only of 
willingness to do, but of imwillingness not to do my own think- 
ing. I prepared a thesis or special report for Mr. Brooks on the 
Farmers' Alliance Movement which was helpful to me in de- 
vising methods of getting data and in arriving at an understand- 
ing of a particular problem. 

No. 228. A.B. (cmn laude) Class of 1891. Economics i, 6, 
and 2 (half year). 

In trying land damage cases in court, I find that the subject 
of real estate values and rents is illimiinated by what I leamed 
in this course. (Economics i). Business and affairs are the 
practical matters with which the activities of most of us are con- 
cemed; the courses in political economy lie doser to our later 
work than any other courses excepting possibly the English 
composition courses. The general discussions in dass led by 
Professor Taussig were most interesting and hdpful. They 
were more valuable than thesis writing. The latter is chiefly 
research work which has no permanent value different from the 
research work done in history or other courses. 

No. 22g. LL.B. Class of 1912. Economics i, 3, 18, 4, and 
2B. Social Ethics i. 

The real value from a course comes from the ability of the 
instructor to interest the student enough to do more than the 
required work and to continue study of it after college. Both 
Professors Carver and Gay sent me away feeling that I had 
been introduced to a subject worthy of further development; 
Professor Cole's course completed the training for one who does 
not become an expert accountant and has been of great value 
in several ways, especially in that the language of the business 
world is not Greek to a college man. The course in sociology 
was very instructive and of great value to a lawyer. 
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No. 67. A.B. LL.B. Class of 1906. Economics i, 6, 8a, 
8b, 18, and 21. 

Of these courses, by far the most useful since graduation was 
Mr. Cole's course on Accounting. I cannot speak too highly of 
it. Professor Sprague's Economics 6, Financial History of the 
United States, and Economics Sa and 8i, Money and Banking, 
were interesting and instructive, but I have not found the in- 
formation gained in them of any real value in the practice of 
law. Economics 21, on Business Law, I have always regarded 
as time wasted. 

No. 106. A.B. (cnm laude) LL.B. Class of 1907. Eco- 
nomics I, 6, 8a, 8b, 12b, 23^, 23^, 12a. Treasurer. 

Except for Economics 21, I do not value the courses on the 
basis of subject matter. In all of Mr. Carver's courses the 
greatest value was foimd in watching his mind work. Every de- 
velopment was so absolutely mathematically correct. ... All 
courses in college were to my mind developers and the acquisi- 
tion of miscellaneous information a mere chance which might as 
well occur in general reading as in a course. ... I desire to 
raise a query as to the concrete benefits of courses on special 
subjects. For instance, the course on corporations is undoubt- 
edly a wonderful course, but outside of the men who went to law 
school and learned it all over not one in fif ty can state a single 
faet in the laws of corporations in restraint of tråde. It did 
however grease a lot of heads which had done no previous think- 
ing. The title caught the subjects but the course produced the 
results and the Sherman Aet did not. 

No. 2yo. A.B. (magna cnm laude) LL.B. Class of 1909. 
Economics i and 2. 

These two courses taken together constitute a general incur- 
sion into the subject and fumish a good working knowledge of 
economics which I believe to be a necessary part of a lawyer's 
equipment. These courses . . . have fumished a basis upon 
which I can rely in acquiring such special knowledge in a par- 
ticular part of tbe subject as may from time to time be needed; 
for example, foreign exchange during the last smnmer, or anti- 
trust matters in relation to the Sherman and Clayton Acts. 
Economics 2, in its conference method of presentation, is a 
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most excellent mental training. I foimd it very helpful in pre- 
paring the way for a similar presentation of law in the law 
school. 

No. lyg. LL.B. Class of 1907. Economics i, 4, 5, 9b, 6a, 
6b, 8a, 8b, 11, 7a, 7b, 18, and 21. Deputy Attomey 
General (State). 

The courses have been of imdoubted value to me in my law 
practice, both in general practice and while representing the 
State. They gave me an imderstanding of the methods of 
business and general principles on which business should be 
carried on. They gave me a training in method of study, valu- 
able in law school and in practice, especially in how to evolve 
general rules from concrete facts. In general practice, aside 
from technical practice rules (e. g. Evidence, Code Pleading), 
in giving advice, especially in Corporation matters, I f oimd that 
the knowledge acquired gave me a dedded advantage over other 
men of my age who had not studied much economics. As part 
of a liberal education, they have been of value to me in my 
politicai activities, and socially, by enabling me to comprehend 
and discuss intelligently questions of govemment and other 
questions of general interest. 

No. 177. A.B. (magna cnm laude) A.M. LL.B. Class of 
1901. Economics i. 

Of no perceptible value in my vocation. Certainly an addi- 
tion to general knowledge in imderstanding the meaning of 
terms, names of theories, and exponents of theories. In civic 
activities (such as City Club of New York, Department of 
Public Charities, etc.)i a lawyer naturally contributes the 
special professional knowledge he has whidi others may not 
bring, and in such spedalty I cannot see that theoretical eco- 
nomics plays any valuable part. Of course an aid in pleasant 
intercourse with fellow-men, like any other bit of knowledge; 
nothing more, discemibly. 

No. 71. A.B. (cum laude) LL.B. Class of 1909. Eco- 
nomics I, 5, 9b, 2, 6b. 

I think that the courses on the general subject are essential 
to a well rounded education. They are of real cultural value. 
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I have foimd none of the courses valuable in my profession ex- 
cept in the very broadest sense. There is a course in Account- 
ing which I believe is listed in the Department of Economics 
which I regret not having taken. This is a course which I 
think niunbers of my profession will agree is of great practical 
value to them. 



The Value of Economics Courses to Manufacturers 

Of this group 7 took Economics i only, 2 took only two 
conrses in the Department, and 9 took three or more courses. 
Five were graduated before 1900, 2 between 1899 and 1908, 
and 2 from 1908 to 1913, indusive. 

Value in Vocation 

Nttmber Per Cent 

Number of replies considered i8 — 

Deddedly advantageous in vocation . . 3 17 
Favorable comment, moderate or iincer- 

tain statements 7 39 

Unfavorable comment o o 

Totals: Advantageous 10 56 

Of slight value if any .... o o 

No comment 8 44 

Social or Civic Value 

Number Per Cent 

Number of replies considered 18 — 

Favorable comment, moderate or uncer- 

tain statements 3 17 

No comment made 15 83 

General CuUure Values 

Number Per Cent 

Number of replies considered 18 — 

Deddedly helpful in these respects. . . 3 17 

Favorable comment, moderate or uncer- 

tain statements 9 50 

Totals: Favorable 12 67 

No comment made 6 33 

The answers from this group were very brief as a rule and 
it seems likely that the questionnaire did not receive as much 



124 ^^^ TEACHING OF ECONOMICS 

attention from the manufactnrers as it did from the lawyers. 
For this reason it appears probable that the same weight 
should not be given to the tabulation of i*eplies as would 
otherwise be expected. 

Four (22 per cent) make no comment on the benefits de- 
rived from their conrses in Economics. Four mention that 
they have foimd the information of value in business affairs. 
Four were helped in deciding politicai issues or questions of 
public economic policy. Three (17 per cent) foimd the 
courses a stimulation to thought on economic subjects and 
three others felt that the principles laid down had formed 
the basis of their later thought. Two (11 per cent) speak 
of the course as having been valuable mental discipline. 
Two more regard their courses as a general introduction 
to the field of economic reading and thought. One man 
speaks of being sufficiently interested to do f urther reading, 
and another was helped in the comprehension of the terms 
used in tråde journals and in conversation with business 
men. One believes that the specific facts were of no 
value to him, although he derived other benefits from the 
courses. 

It is significant that none of the manufactnrers mention 
the course in Banking as having been of practical value, 
although three took the course. Of five who took Ac- 
coimting, two mention it as having proved valuable. 
One speaks in high terms of the courses on railroads and 
two of commercial law. 

Quotations from Manufactnrers on the Value of Economic 

Courses 

No. 148. A.B. (magna cimi laude) Class of 191 2. Eco- 
nomics I, 2, 6a, 6b, 7, 18, and 9. 

The principles with which I became acquainted in the various 
courses in Economics which I took in college have fomied so 
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fundamental a part of my general line of thought that they have 
undoubtedly greatly influenced me in business and been of 
value to me in every aspect of my life. . . . The work of Eco- 
nomics i8 and that of the courses in Business Law have been of 
concrete service in every business matter with which I have had 
to do. 

No. 187. A.B. Class of 1903. Economics i. 

The course has not been of value in iny vocation. It has in- 
creased my interest in and understanding of civic questions 
through belief in the need of sociological-economic reforms. It 
has not been valuable in more general ways. 

No. 2Q3. A.B. (cum laude) A.M. Class of 1903. Eco- 
nomics I, 8a, and 8b. 

I consider that the coiu'ses in economics have been of real 
substantial value; in particular in giving a better understanding 
of the broad questions related to them which come up both in 
business life and as questions of public economic policy. I do 
not consider the specific facts as of particular value, but feel that 
the imderstanding which they give of the deep underlying prin- 
ciples, however imperfect it may be, gives a real basis for better 
judgment and foresight on the private questions of one's own 
business policy as well as public matters. 

The Value of Economics Cour ses to Physicians and Surgeons 

Of this group 6 took Economics i only, 6 took two courses, 
and 3 took three or more courses. Eight were graduated 
before 1900, and the remaining 7 between 1899 and 1908. 

Value in Vocation 

Number Per Cent 

Number of replies ænsidered 15 — 

Favorable comment, moderate or uncer- 

tain statements i 7 

Deddedly adverse æmment i 7 

Adverse, less vigorous comment .... i 7 

Totals: Favorable comment i 7 

Of slight value if any .... 2 13 

No comment made 12 80 
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Social ar Civic Values 

Nttmber Per Cent 

Number of leplies considered 15 — 

Deddedly hdpful in these respects. . . 2 13 

Favorable comment, moderate or iincer- 

tain statements 5 33 

Totals: Favorable comment 7 47 

No comment made 8 53 

General Culture Values 

Number Per Cent 
Number of replies considered ..... 15 — 

Deddedly helpful in these respects. . . 3 20 

Favorable comment, moderate or micer- 

tain statements 8 53 

r(7to/5: Favorable comment 11 73 

No comment made 4 37 

Eight (53 per cent) speak of the courses as valuable in 
"broadening one's education,'* as a " contribution to general 
culture," or as giving "general training and knowledge." 
Five (33 per cent) were helped to a better understanding of 
social questions and s others were better able to form 
an opinion on political issues. Three (20 per cent) had 
a clearer insight into financial operations, which they 
considered of value. Two had foimd the courses in 
Banking helpful. One had been helped in his general 
reading, another in ordinary conversation, and a third 
considered the courses a part of a valuable f oimdation for 
his later studies. 

Quotations from Physicians 

No. 30Q. A.B. M.D. Class of 1896. Economics i and 7. 
Hospital Superintendent. 

These courses have been of value in helping me selve some of 
my medical problems, as quite a portion of my work has been 
in connection with the poor or working people. Espedally is 
this true of Economics i. 
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No. 72. A.B. (cmn laude) M.D. Class of 1899. Eco- 
nomics i and 6. 

Economics 6 gave me a knowledge without which I could not 
have properly understood many of the contemporary govem- 
mental problems. The thesis I wrote on the Merchant Marine 
has been of value in late years in coaching school debates and 
in friendly argiunents since the war broke out. All in all, I 
consider it one of my most valuable courses. 



The Value of Economics Courses to EditorSy Journalists, 

and Newspaper Men 

Of this group 3 took Economics i only, 2 took two or 
more courses, and 5 took three or more courses. Three were 
graduated before 1900, 3 between 1899 and 1908, and 4 
between 1908 and 1913, indusive. 

Value in VocaHon 

Nnmber Per Cent 

Number of replies considered lo — 

Deddedly advantageous in vocation . . 3 20 
Favorable comment, moderate or iincer- 

tain statements 4 40 

Deddedly adverse comment 2 20 

Adverse, less vigorous comment .... 2 20 

Totals: Favorable comment 6 60 

Slight value if any 4 40 

Social or Civic Valnes 

Number Per Cent 

Nmnber of replies considered 10 — 

Deddedly helpful in these respects. . . x 10 
Favorable comment, moderate or uncer- 

tain statements 3 30 

Totals: Favorable 4 40 

No comment made 6 60 

General Culture Values 

Number Per Cent 

Number of replies considered 10 — 

Deddedly helpful in these respects. . . z 10 
Favorable comment, moderate or uncer- 

tain statements 5 50 

Totals: Favorable comment 6 60 

No comment made 4 40 
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Three regard their courses as having "cultural" value and 
3 praise "mental training" and "methods of study." Two 
were given a broader outlook which they considered valuable 
to a writer and 2 felt that their interest had been awakened 
in certain economic problems. One had foimd the conrse in 
Accoimting of practical assistance. One had been helped in 
finding material, and another regarded his courses as a good 
foimdation for further study. 

Quotatians from Journalists^ Editors ^ etc. 

No. 276. A.B. (sunmaa cum laude) Class of 1907. Eco- 
nomics i, 14a, and 14b. Bureau of Education, Wash- 
ington, D. C. 

I still consider Economics i probably the most valuable course 
I took in college. For my present work in surveying the general 
educational field it was indispensable. . . . The opportunity to 
get different points of view, as represented by diff erent men — 
Taussig, Andrews, Ripley, etc. — was especially valuable. 

No. igi. A.B. Class of 1903. Economics i, 6, 9, 18, and 
21. With . . . and Company, educational publishers. 

Courses 9, 18, and 21 have all been valuable in my vocation. 
Economics 9 gave me an imprejudiced view of the labor problem 
before I came in contact with iht view of the employer. 18 was 
valuable because in executive work I have constant need to know 
the meaning of accounts, how to construct them so as to show the 
actual condition of business, and how to interpret them. The 
study of cases in Economics 21 was good mental drill and training 
for business life. The case method gave me a good idea of what 
the common law is and how an attomey gæs to work to make 
up his case. All my courses in Economics were among Harvard's 
most valuable contributions to my "liberal education." 

The Value of Economics Courses to Educators^ Professors ^ 

TeacherSj and Ministers 

Of this group 18 took Economics i only, 10 took two 
courses, and 24 took three or more courses. Thirteen were 
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graduated before 1900, 26 between 1899 and 1908, and 13 
from 1908 to 1913, inclusive. Nine were professors of 
Economics. Four (8 per cent) made no comment on the 
value of the conrses to them. 



Value in Vocation 

Number Per Cent 

Number of replies considered 52 — 

Decidedly advanta^eous in vocation . . 8 15 
Favorable comment, moderate or uncer- 

tain statements 10 19 

Vigorous adverse æmment 2 4 

Adverse, less vigorous comment .... 3 6 

Totals: Advantageous 18 35 

Of slight value if any .... 5 10 

No comment made 29 56 

Social or Civic Values 

Number Per Cent 

Number of replies considered 52 — 

Deddedly helpful in these respects. . . 4 8 
Favorable comment, moderate or uncer- 

tain statements 14 37 

Deddedly adverse comment i 2 

Adverse, less dedded comment .... i 2 

Totals: Favorable comment 18 35 

Of slight value if any .... 2 4 

No comment made 32 62 

General Culture Values 

Number Per Cent 

Number of replies considered 52 — 

Decidedly helpful in these respects. . . 6 11 
Favorable comment, moderate or uncer- 

tain statements 28 '54 

Vigorous adverse comment i 2 

Totals: Courses helpful 34 66 

Of slight value if any .... i 2 

No comment made 17 33 

The replies from this group are usually very brief and 
many of them are imsatisfactory because the statements 
tend to be very general, sometimes imcertain in meaning, 
and are rarely concrete or objective. 
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Fifteen (29 per cent) found their courses helpful in form- 
ing opinions on political issues. Eleven (21 per cent) were 
helped in solving social problems or in conducting sociolog- 
ical investigations. Several of these were ministers. Eleven 
(21 per cent) felt that new interest had been aroused in 
questions of which they were previously ignorant, or that 
their outlook had been broadened. Six (12 per cent) were 
better able to imderstand "current economic problems." 
Eight (15 per cent), who were not teachers of Economics, 
had gleaned information from the courses which had been 
useful in presenting their own work in schools or colleges. 
Among those who used such information, one was teaching 
English, one Agriculture, and another History. Five (10 per 
cent) spoke of having received training in reasoning or in 
critical thinking (mental discipline). Four (8 per cent) 
mentioned ^^cultural values." Four others were better able 
to imderstand business affairs or had received a "general 
training which was useful in the business affairs of life." 

Three (6 per cent) regarded their study of the subject as 
having provided the basis for much of their present trend of 
thought or as having altered their outlook upon life. Three 
were led to do f urther reading or were stimulated in a desire 
for "more culture and information." Two regarded their 
courses as a general introduction to the field of economics. 
Two mention the course in Accoimting and one the course 
in Banking as having been of material assistance in practical 
affairs. 

Qtcotations 

No. 151. A.B. (cum laude) A.M. LL.B. Class of 1906. 
Economics i, 2, 3, 6, 12b, and 16. Lecturer on economic 
subjects. 

Economics 2 in particular was extremely stimulatuig to 
critical thinking. A certain amoiint of Economics is absolutely 
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essential ... to show the superfidal but cocksure ignorance 
of the average successful lawyer or business man in discussing 
public affairs. 

No. 24. A.B. (cmn laude) A.M. Class of 1901. Eco- 
nomics i, 5, 6, 7, 9, 17, and 20. Education. Adminis- 
tration. 

The course in Accounting has been of great practical value 
both during a year and a half in a raikoad office and since in 
School Administration. Some scraps of information have been 
valuable in my teaching but my real profit from the courses was 
through personal association with men like Ashley, Dunbar, 
and Taussig. I consider my work in Economics cultural and 
not vocational. It was the historical coiu^ses that I valued most 
highly. 

No. 81. A.B. (cmn laude) A.M. Ph.D. Class of 1901. 
16 courses in Economics. Assistant Professor of 
Economics. 

The courses I took at Harvard have been of value from the 
point of view of content and training in the work. They awoke 
or strengthened my interest in the subject, and of course greatly 
influenced my whole outlook on life. It is not easy to distin- 
guish in other ways between this preliminary training and the 
work I have done since. 

No. 141. A.B. Class of 1894. Economics i. Minister. 

No course taken in college has proved more valuable. For 
twenty years I have been active in social, civic, and labor work. 
As a minister and social worker I have many times been thank- 
f ul for the elementary training in economic reasoning afforded 
by Economics i. 

No. 250. A.B. (Comell) A.M. 1905. Ph.D. Several 
courses in Economics. Associate Professor of Sociology. 

Naturally the courses taken have been of direct value to me 
in my work as a teacher. Quite as naturally, perhaps, I find 
them of direct use in my activities as a citizen. They give added 
interest in following political and social movements. 
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The Value of Economics Courses to Business Men, Including 

Bankers j Brokers, Merchants, Clerks, Salesmen, 

Advertisement Writers, Buyers, and 

Insurance Agents 

Of this group lo took Economics i only, lo took two 
courses, and 32 took three or more courses. Twenty-one 
were graduated before 1900, 20 between 1899 and 1908, 
and II from 1908 to 1913, inclusive. 

Value in Vocation 

Nttmber Per Cent 

Number of replies considered 52 — 

Deddedly advantageous in vocation . . 6 12 
Favorable comment, moderate or uncer- 

tain statements 33 43 

Vigorous adverse æmment 3 6 

Adverse, less vigorous æmment .... 3 4 

Totals: Helpful in vocation 38 54 

Of slight value if any .... 5 10 

No comment made 19 37 

Social or Civic Value 

Nttmber Per Cent 

Number of replies considered 53 — 

Helpful in these respects 13 33 

No comment made 40 77 

General Culture Values 

Number Per Cent 

Number of replies considered 53 — 

Deddedly helpful in these respects. . . 4 8 
Favorable comment, moderate or uncer- 

tain statements 39 56 

Totals: Favorable comment 33 64 

No comment made 19 37 

Fourteen (37 per cent) foimd Accoimting a highly valu- 
able subject. Several suggest that this course should be 
compulsory for those who expect to be business men or 
lawyers. Four think that the course might have proved 
very much more helpful if it had been conducted in a differ- 
ent way. (See Suggestions on Economics 18.) Five (10 
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per cent) speak of the work on banking as having proved 
of practical assistance. Fonr (8 per cent) were helped by 
courses on railroads or transportation. Six (12 per cent) 
mention "valuable mental training'' or say that they were 
helped to think in a "practical way." Six (12 per cent) 
were better able to form correct views on current economic 
questions. Five (10 per cent) mention social problems and 
seven (14 per cent) speak of political issues in the same 
way. Four were able to gain a foothold in business with 
less difficulty because they imderstood technical terms and 
underlying principles. Five regarded their courses as having 
paved the way for more general reading and study along 
economic lines. Three were better able to find articles or 
look up data bearing on the problems which they had to 
solve. Four valued the courses for a broad outlook upon the 
business world. Three had gained a conception of the 
imderdeveloped resources and possibUities of future growth 
of the United States which had helped them in business. 
Only two valued their courses as part of a liberal education. 
One had been helped in managing the economic affairs of 
his household. 

Qtwtations 

No. 186. A.B. Class of 191 1. Economics i, 5, 18. Bond 
Broker. 

The courses in Economics have proved more valuable to me 
than all the rest of my college course. The course in Railroads 
affects me directly in my business. Economics 18 is of the ut- 
most value to me, and I refer to Mr. Cole's book often. These 
courses teach you to think in a more practical way than any 
other subject can and they give you a foothold in any business. 

No. 24Q. A.B. Class of 1913. Economics i, 6a, 6b, 18, 
and others. Fruit Grower. 

Out of six or seven courses in Economics, I got nothing from 
any particular requirement, but rather gained a broader out- 
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look on life through the greater field of vision gained from the 
whole course. . . . My business calls for planting trees on 
hitherto unbroken ground. Many people have said that I 
would get discouraged, that it could not be done profitably, 
etc. ... I believe that every Harvard man who has taken 
any courses in Economics or Philosophy gets and always 
keeps with him an imagination, an outlook on life that 
always gives him hope and courage to be able to find a way 
to do an3rthing. 

No. 8. A.B. Class of 191 1. Economics i, 8a, 8b, 18, 21, 
and 23. Citrus Fruit Grower, Califomia. 

• 

Economics i was possibly of some help in labor problems, 
possibly of help in imderstanding public questions. ... I was 
able to make considerable use of Economics 18 in revising the 
cost accounting on the ranch and expect to get a lot more help 
in the future in the same line. . . . Courses 8a, 8b, 21, and 23 
have been of little if any practical value except that I f eel that the 
general mental training in seeing things from a broader economic 
viewpoint is of ten of considerable indirect value. 

Value of Economics Cour ses to Farmers and Foresters 

Of this group i graduated before 1900, 2 between 1899 
and 1908, and 6 from 1908 to 19 13, inclusive. Two took 
Economics i only, i took two courses, and 6 took three or 
more courses. 

Value in Vocation 

Number Per Cent 

Number of replies considered 9 — 

Deddedly advantageous in vocation . . i 11 
Favorable comment, moderate or uncer- 

tain statements 5 56 

Totals: Favorable comment 6 67 

No comment made 3 33 

Social or Civic Values 

Number Per Cent 

Nmnber of replies considered 9 — 

No comment made 9 100 
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General Ctdture Values 

Number Per Cent 

Number of replies considered 9 — 

Decidedly helpful in these respects. . . i 11 
Favorable comment, moderate or uncer- 

tain statements 5 56 

Totals: Favorable comment 6 67 

No comment 3 33 

Two found the courses valuable because they gave a new 
Outlook upon Uf e and enabled the student to see things from 
a different point of view. Two were helped in solving 
political problems and 2 had received valuable mental 
training. One regarded the courses as part of a general 
education, one had been helped by imderstanding the laws of 
tråde, and one had made good use of the course on Accoimting 
(Economics 18). 

Value of Economics Cour ses in Various Vocations 

I n ra IV V VI vn 
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Vocational 39 56 7 60 35 54 67 

Social-Civic 26 17 47 40 35 23 22 

General Culture .... 70 50 53 60 66 64 67 
Forming Opinions on 

Politicai Issnes ... 13 22 33 o 29 14 22 
Social Problems, Current 

Economic Questions .25 17 17 20 21 12 o 
Habits of Thought; 

Mental Discipline . . 16 11 o 30 10 12 o 

Accounting 10 11 o 10 4 37. 11 

Banking 4 o 13 o 2 10 o 

Further Reading and 

Study 10 6 7 10 6 10 o 

Nimiber in the Group . 72 18 15 10 52 52 9 

Notes: Groups m, IV, and VII are too small to admit of any important con- 
clusions from the results. The subjects tabulated are points explidtly mentioned 
in the replies as values resulting from the courses and do not indude inf erences 
which might readily be drawn in many cases from the nature of the replies. 
Figures represent percentages of total niunber of replies from the given vocation. 
The colimms do not total 100 per cent because the headings overlap in several ways. 
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Section Meetings and Assistants 

Fif ty-thxee men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself. In 
many cases general statements are made conceming the 
inefifectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amoimt of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five replies insist that more experienced men be placed in 
charge of the sections and 4 point out that the assistants 
lacked teaching experience. 

Eight think that more time should have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of reading. Two say that the section meeting was 
conducted as a means of finding out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted efifort in memorizing the work in a certain order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had frequently to wait while attention was 
given to an individual whose difficnlties were not common to 
the others. 

Two say that their instructor was of imusual ability, one 
that the papers were fairly and carefully marked, and one 
that the debate was foimd helpful. 

Qtcotations 

No. 226. A.B. (simuna cum laude) Class of 1905. A.M. 
Economics i, 2, 5a, 5b, 6a, 6b, 8a, 8b, 9, etc. EflBiciency 
Expert, Manufacturing. 

An extension of dass discussion under the guidance of a 
master of his subject would drive the principles of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this purpose. All honor td the 
Austin Teaching Fellows; they struggle manfully with their 
little sections and answer admirably the purpose of making 
some of the students inhale the weekly outside readings; but 
they do not get under the skin of the undergraduate. I re- 
member more of the courses under Professor Taussig and Pro- 
fessor Garver in which these fuU grown men directed the class 
discussions than I remember of any two other courses which 
consisted entirely of lectures or of two lectures plus one section 
meeting imder a fledgling. . . . Suppose one or more of the fuU 
professors were each to take one of the sections each week. 
Every section would thus get a thick slice of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting impression 
on the minds of the students. 

No. 2ig. A.B. (magna cum laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the courses I took the one that to my mind could and 
should be improved was Economics i, with regard to the work 
in the sections. Whether this was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it. 
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Section Meetings and Assistants 

Fif ty-thxee men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself. In 
many cases general statements are made conceming the 
inefifectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amoimt of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five repUes insist that more experienced men be placed in 
charge of the sections and 4 point out that the assistants 
lacked teaching experience. 

Eight think that more time should have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of reading. Two say that the section meeting was 
conducted as a means of findmg out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted efifort in memorizing the work in a certain order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had frequently to wait while attention was 
given to an individual whose difficnlties were not common to 
the others. 

Two say that their instructor was of imusual ability, one 
that the papers were fairly and carefully marked, and one 
that the debate was found helpful. 

Qiwtations 

No. 226. A.B. (simuna cum laude) Class of 1905. A.M. 
Economics i, 2, 5a, 5b, 6a, 6b, 8a, 8b, 9, etc. EflBiciency 
Expert, Manufacturing. 

An extension of dass discussion under the guidance of a 
master of his subject would drive the principles of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this purpose. All honor td the 
Austin Teaching Fellows; they struggle manfuUy with their 
little sections and answer adinirably the purpose of making 
some of the students inhale the weekly outside readings; but 
they do not get imder the skin of the imdergraduate. I re- 
member more of the courses imder Professor Taussig and Pro- 
fessor Garver in which these fuU grown men directed the class 
discussions than I remember of any two other courses which 
consisted entirely of lectures or of two lectures plus one section 
meeting imder a fledgling. . . . Suppose one or more of the full 
professors were each to take one of the sections each week. 
Every section would thus get a thick slice of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting impression 
on the minds of the students. 

No. 2ig. A.B. (magna cum laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the courses I took the one that to my mind could and 
should be improved was Economics i, with regard to the work 
in the sections. Whether this was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it, 
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Section Meetings and Assistants 

Fifty-thxee men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself. In 
many cases general statements are made conceming the 
inefifectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amount of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five rephes insist that more experienced men be placed in 
charge of the sections and 4 point out that the assistants 
lacked teaching experience. 

Eight think that more time should have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of reading. Two say that the section meeting was 
conducted as a means of finding out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted efifort in memorizing the work in a certain order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had f requently to wait while attention was 
given to an individual whose difficulties were not common to 
the others. 

Two say that their instructor was of imusual ability, one 
that the papers were fairly and carefully marked, and one 
that the debate was foimd helpful. 

Qtiotations 

No. 226. A.B. (simuna cimci laude) Class of 1905. A.M. 
Economics i, 2, 5a, 5b, 6a, 6b, 8a, 8b, 9, etc. EflBiciency 
Expert, Manufacturing. 

An extension of class discussion under the guidance of a 
master of his subject would drive the principles of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this puipose. All honor td the 
Austin Teaching Fellows; they struggle manfully with their 
little sections and answer adinirably the puipose of making 
some of the students inhale the weekly outside readings; but 
they do not get imder the skin of the undergraduate. I re- 
member more of the courses under Professor Taussig and Pro- 
fessor Garver in which these full grown men directed the class 
discussions than I remember of any two other courses which 
consisted entirely of lectiures or of two lectiures plus one section 
meeting \mder a fledgling. . . . Suppose one or more of the full 
professors were each to take one of the sections each week. 
Every section would thus get a thick slice of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting unpression 
on the minds of the students. 

No. 2 1 g. A.B. (magna cimi laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the coiurses I took the one that to my mind could and 
should be unproved was Economics i, with regard to the work 
in the sections. Whether this was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it. 
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Section Meetings and Assistants 

Fif ty-three men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself . In 
many cases general statements are made conceming the 
inefifectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amount of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five rephes insist that more experienced men be placed in 
charge of the sections and 4 point out that the assistants 
lacked teaching experience. 

Eight think that more time should have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of readmg. Two say that the section meeting was 
conducted as a means of findmg out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted efifort in memorizing the work in a certain order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had frequently to wait while attention was 
given to an individual whose difficulties were not common to 
the others. 

Two say that their instructor was of imusual ability, one 
that the papers were fairly and carefully marked, and one 
that the debate was foimd helpful. 

Quotations 

No. 226. A.B. (simuna cnm laude) Class of 1905. A.M. 
Economics i, 2, 5a, sb, 6a, 6b, 8a, 8b, 9, etc. EflBiciency 
Expert, Manufacturing. 

An extension of class discussion under the guidance of a 
master of his subject would drive the principles of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this puipose. All honor td the 
Austin Teaching Fellows; they struggle manfully with their 
little sections and answer admirably the puipose of making 
some of the students inhale the weekly outside readings; but 
they do not get under the skin of the undergraduate. I re- 
member more of the courses under Professor Taussig and Pro- 
fessor Garver in which these fuU grown men directed the class 
discussions than I remember of any two other courses which 
consisted entirely of lectures or of two lectures plus one section 
meeting imder a fledgling. . . . Suppose one or more of the fuU 
professors were each to take one of the sections each week. 
Every section would thus get a thick sUce of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting impression 
on the minds of the students. 

No. 21Q. A.B. (magna cum laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the courses I took the one that to my mind could and 
should be improved was Economics i, with regard to the work 
in the sections. Whether this was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it. 
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Section Meetings and Assistants 

Fif ty-thxee men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself . In 
many cases general statements are made conceming the 
inefifectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amount of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five repUes insist that more experienced men be placed m 
charge of the sections and 4 point out that the assistants 
lacked teaching experience. 

Eight think that more time should have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of reading. Two say that the section meeting was 
conducted as a means of finding out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted efifort in memorizing the work in a certam order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had frequently to wait while attention was 
given to an individual whose difficnlties were not common to 
the others. 

Two say that their instructor was of imusual ability, ene 
that the papers were fairly and carefully marked, and ene 
that the debate was found helpful. 

Qtwtations 

No. 226. A.B. (simuna cum laude) Class of 1905. A.M. 
Economics i, 2, 5a, 5b, 6a, 6b, 8a, 8b, 9, etc. EflBiciency 
Expert, Manufacturing. 

An extension of class discussion under the guidance of a 
master of his subject would drive the principles of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this puipose. All honor td the 
Austin Teaching Fellows; they struggle manfully with their 
little sections and answer admirably the puipose of making 
some of the students inhale the weekly outside readings; but 
they do not get under the skin of the undergraduate. I re- 
member more of the courses under Professor Taussig and Pro- 
fessor Garver in which these full grown men directed the class 
discussions than I remember of any two other courses which 
consisted entirely of lectures or of two lectures plus one section 
meeting under a fledgling. . . . Suppose one or more of the full 
professors were each to take one of the sections each week. 
Every section would thus get a thick slice of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting impression 
on the minds of the students. 

No. 2ig. A.B. (magna cum laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the courses I took the one that to my mind could and 
should be improved was Economics i, with regard to the work 
in the sections. Whether this was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it. 
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Section Meetings and Assistants 

Fif ty-thxee men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself. In 
many cases general statements are made conceming the 
inefifectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amount of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five rephes insist that more experienced men be placed in 
charge of the sections and 4 point out that the assistants 
lacked teaching experience. 

Eight think that more time should have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of reading. Two say that the section meeting was 
conducted as a means of finding out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted efifort in memorizing the work in a certain order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had frequently to wait while attention was 
given to an individual whose difficnlties were not common to 
the others. 

Two say that their instructor was of unusual ability, one 
that the papers were fairly and carefully marked, and one 
that the debate was foimd helpful. 

Qtwtations 

No. 226. A.B. (simuna cnm laude) Class of 1905. A.M. 
Economics i, 2, 5a, 5b, 6a, 6b, 8a, 8b, 9, etc. EflBiciency 
Expert, Manufacturing. 

An extension of class discussion under the guidance of a 
master of his subject would drive the principles of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this purpose. All honor td the 
Austin Teaching Fellows; they struggle manfully with their 
little sections and answer admirably the puipose of making 
some of the students inhale the weekly outside readings; but 
they do not get imder the skin of the imdergraduate. I re- 
member more of the courses under Professor Taussig and Pro- 
fessor Garver in which these fuU grown men directed the class 
discussions than I remember of any two other courses which 
consisted entirely of lectures or of two lectures plus one section 
meeting under a fledgling. . . . Suppose one or more of the fuU 
professors were each to take one of the sections each week. 
Every section would thus get a thick slice of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting impression 
on the minds of the students. 

No. 21 Q. A.B. (magna cum laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the courses I took the one that to my mind could and 
should be improved was Economics i, with regard to the work 
in the sections. Whether this was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it. 
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I do not know, but at least until the first hour-exams, the scope 
and idea of the entire subject was rather hazy to most of the 
men I knew. Personally, I did not find that the section work 
supplemented the lectures and outside reading as it should 
have. 

No. 200. S.B. (cum laude) Class of 191 1. Economics i, 
5, 18, and 28. With . . . Railroad. 

The assistant in this case was a graduate of a smaller college 
who was working for a Ph.D. He was totally out of sympathy 
with his students, and he was positively a detriment. This 
is the main fault with the assistants — they don't care, take no 
pride in their duties, and work merely because it is a mild way 
of pa)dng for their tuition. ... I condemn the sjrstem of using 
unsuitable assistants in the courses. 

No. 165. A.B. (cum laude) Class of 1912. Economics i, 
4b, 6a, 6b, iib, 12, and 16. Law Student. 

One point which in my opinion cannot be overemphasized, is 
the need of having assistants in the larger coiurses who are in- 
terested in the subject and in their students, and who are able 
to guide the discussion in section meetings so that it becomes 
more than a mechanical test of the retentiveness of the student's 
memory and the amount of time he has put on his work. If the 
student is led to anticipate a lively discussion in section meet- 
ing, his preparatory work immediately takes on a different 
aspect. He looks for intellectual problems that he knows he 
will have to grapple with and casts about in his own mind for 
arguments which he can use in the dass room. The deadening 
eflfect of an assistant who merely tries to find out if you Ve done 
the prescribed reading is enough to spoil one's interest in any 
coiurse on Economics. 

No. 6. A.B. (cmn laude) Class of 191 2. Economics i, 4a, 
4b, and 6a. Newspaper (Editorial Department). 

The men who serve as assistants are for the most part im- 
practical men. In writing a thesis on a present-day subject, a 
man needs some guidance from men who have a more practical 
tiun of mind. Theoretical analjrses are not alwajrs sujficient. 
I met yoimg instructors who were so engrossed in their graduate 
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work or in the theoretical principles of Economics that they 
apparently found little time to read the newspapers or current 
magazines. 

No. 22p. LL.B. Class of 1912. Economics i, 2b, 3, 4, and 
18. Lawyer. 

The manner in which the instructors (not the professors) 
graded theses as task jobs and with no attempt to recognize or 
preserve original research leads one to give them what they 
seem to want — i. e., a hackneyed piece of work of so many 
pages that is easy to read (a typewritten thesis being sure of a 
passing grade). In one case, I deliberately copied a thesis from 
a book of a former Harvard Professor in the same course and 
received an A on it. Needless to say that ended my interest 
in thesis courses. 

No. 2y6. A.B. (summa cimi laude) Class of 1907. Eco- 
nomics I, 14a, and 14b. Editor. 

The review section with its discussion of the lectures and 
readings of the week was stimulating, possibly because the 
section-man was considerably above the average of the as- 
sistents. 

Practical Applications 

The f ollowing paragraphs elaborate the data given above 
imder the head of Suggestions and Criticisms, part (a). 

Sixty-three men criticize in various ways the practical 
applications made in the Economics conrses. Thirty-five 
of these state that in nearly all courses more emphasis ought 
to be placed upon practical problems of the present day. 
They seem to think that for the great majority of students 
the matter dealt with was too theoretical, philosophical, or 
historical, and had too Httle concrete appKcation to problems 
with which the classes could be expected to be familiar. 
Discussions of a theoretical character appear to have left 
little or no impression unless they were applied to actual 
conditions through theses, discussions, or irivestigations 
on the part of the student. In this connection it may be 
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interesting to note that ten replies were received containing 
statements to the eflfect that the writers had forgotten all 
of the material leamed in Economics and that so far as they 
conld see they had derived no benefit from the study. Two 
of these admit that they did not study as they shonld have 
done and received passing grades by cramming for examina- 
tions. (These ten are not included in the 63 tabnlated 
above.) 

Seven suggest that visits be made to banks, stock ex- 
changes, factories, and various business houses in order to 
give the students the needed contact with the business 
world. Several suggest that speakers from the outside be 
brought in to lecture on the fieids in which they have proved 
successful. Three believe that there should be illustrations 
of the actual transactions of banking, stocks and bonds, etc, 
for the sake of students who have had a limited experience 
or a deficient secondary school preparation. Debates on 
contemporary issues are frequently spoken of as a good 
means of arousing interest and stimulating further study. 

Among the topics which are mentioned as being neglected 
are: labor problems from the employer's point of view 
(6 replies); socialism (5); foreign exchange (i); scientific 
management and business organization (i); single tax (i). 
Four men want the department to do more toward teaching 
correct ideals of citizenship and 3 think that more should 
be done toward combating the propaganda of the radical 
press. 

Two want the principles expoimded by Mill more thor- 
oughly applied to modem times and i thinks that the time 
spent in reading Spencer was entirely wasted. Two think 
that students get a false conception of the significance of 
present-day problems due to the predominance of theoretical 
and historical discussions. 

Two think that it would be helpful to present a brief 
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summary or survey of the principal factors in our own 
economic system in order that the student may have some 
concrete f oimdation upon which to base his later theoretical 
study. Three suggest that students be earlier familiarized 
with the current literature on economic questions both in the 
technical and in the popular periodicals. Two are of the 
opinion that much valuable aid could be rendered graduates 
by the publication of annotated bibliographies of current 
economic literature. Lack of guidance from mature, 
practical men in selecting courses and in writing theses 
was felt to be a serious fault by two persons. 

Quotations 

No. 38. A.B. Class of 1906. Economics i, 2, and two 
other courses. Mining Engineer. 

Wherever possible, an application of economic prindples to 
present-day conditions will do more to emphasize the import- 
ance of the theory and to impress the same on the mind than 
any amount of "extra reading" or thesis work. A free discus- 
sion of economic theory from all angles is the best possible in- 
centive to study. I got more out of conf erences, I think, than 
out of all the rest of the work. The instructor allowed a certain 
amotmt of inf ormality and toward the end debate was pretty 
strong. One excellent feature is to encourage independent ideas 
and bring them up for discussion. 

No. 56. A.B. A.M. (Bis.) Class of 189 1. Economics i 
and 2. Lawyer. 

I think the aim should be, without diminution of training in 
sound economic thinking, to develop real economists who are 
in touch with modem conditions, particularly in the United 
States. As one who took Economics as a mere side issue, and 
as a citizen who is profoundly interested in the problems of to- 
day, I feel the country's sore need of broad-minded, well- 
grotmded, well-informed, up-to-date economists. I am sorry 
to say that I think there are few in the coimtry. Those who 
profess to be economists are too nearly exclusively concemed 
in the far-away and the highly theoretical. Whether the col- 
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lege can do an)rthing to remedy this, I don't know. I think it 
ought to try and try hard. 

No. 125. A.B. (cum laude) A.M. Class of 1903. Eco- 
nomics i. Teacher. 

I should suggest . . . that the conf erence questions be applied 
to matters concrete enough to reach the life-interests of the 
student. On one of my pages I find the question, "Can a con- 
vertible paper currency become permanently redundant?" I 
cannot help having a good deal of curiosity as to what I did 
"with that question on my paper. 

No. 149. LL.B. Class of 1903. Economics i (repeated). 
Lawyer. 

I took the course twice. . . . It was more or less unintelli- 
gible both times but at the second try I got through. I think 
the trouble was that I had no practical knowledge of banking 
or commerce and didn't know any of the methods or funda- 
mental facts. It seems to me that a certain amount of practical 
instruction at the beginning . . . would be very useful. You 
can't expect a man to comprehend the first principles of Eco- 
nomics when he does not know the difference between a promis- 
sory note and a draft. I do not think that I am abnormally 
stupid, but I do not think that Economics i, as taught, was of 
any value to me at all. 

No. 166. A.B. (University of Kansas) A.M. Economics 
I, 2, 4, 5, 6, 7, 8, and 20. Farmer and lecturer on 
Economics. 

My general critidsm is that most of the courses were not as 
practical as they should be; depended too much on theories or 
principles which when I have tried to apply them frequently 
did not fit. . . . College teaching is not close enough to busi- 
ness life and activity. ... I have leamed more helpful eco- 
nomics from my farming experiences and from talking with 
business men than I did at Harvard. 

No. jgj. A.B. (cum laude) Class of 1909. Economics i, 2, 
6a, and 6b. Editor, Lecturer. 

Having come to college at a more mature age than most of 
my class-mates and af ter some years' experience in metropolitan 
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joumalism, I was constantly irritated during my courses in 
history, economics, and govemment by the failure of teachers 
to relate class room material to current events. Students were 
not made to feel the vitality of the subjects under discussion. 
Present-day applications, references to new developments in a 
certain field, comments which showed that the teacher had 
read his morning newspaper were rare indeed and, in the case 
of some teachers, altogether absent. Student interest was in- 
variably stirred by such references. . . . (Economics 2). The 
conclusion to which I have come is that economic theory has 
absolutely no bearing on the facts of life except over "long-time 
periods." And since 99 per cent of human concem is with 
"short-time periods," economic theory confotmds rather than 
clarifies. I wasted a lot of time and thought trying to recon- 
cile professorial condusions with reality. I should strongly 
advocate a more honest admission that economic theory is 
largely a survival of the brightest in an intellectual prize fight 
over a definition of terms. 

No. 227. A.B. (cnm laude) Class of 1909. Economics i, 2, 
6a, 6b, and 18. Meat Packer. 

In general (speaking only of courses for my time at college), 
I should suggest that the Department of Economics deem itself 
responsible for presenting to the young men, a large majority 
of whom are going to enter business, as faithful as possible a 
picture of modem business organization, its imtold scientific 
possibilities, and the high ideals that can pervade it. They 
cannot in this work do without the assistance of the high-grade 
business man, who is the man who knows the problems, and 
who would be glad to address the students. 

No. 228. A.B. (cum laude) Class of 1891. Economics 
I, 2, and 6. Lawyer. 

If a piece of legislation like the Rural Credits Bill had been 
given me for investigation and report, I should have been in- 
finitely more benefitted than by digging into the economic as- 
pects of the South Sea Bubble. When it is so easy for the prac- 
tical to assist the theoretical, it should constantly do so. There 
is no reason for Economics to be a "dismal science" if it is co- 
ordinated with contemporary affairs. A student of forestry 
seeks the forests; not all studies have forests to observe, but the 
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whole world every moment offers conditions and events for 
the information and observation of the student of politicai 
economy. 

No. 286. A.B. (magna cum laude) Class of 1907. Eco- 
nomics i, 18, and two others. Accoxintant. 

Like most other college students, I was more interested in 
applied economics than in economic theory. The prindples 
devdoped in the lectures should be more thoroughly applied to 
actual practical cases in the sections or in thesis work. This 
should be done at every stage of the course; otherwise the prin- 
dples leamed seem of little practical importance and are soon 
forgotten. 

No. 2g8. A.B. Class of 1906. Economics i and several 
other courses. Boston Merchant. 

In vocational training the courses given at Harvard are pain- 
fully weak in my opinion, and largely so because they are so far 
removed from the public contact that real business training 
needs. They seem more to train the mind to meet situations 
that may arise in the business world than to offer actual con- 
tact with these situations. . . . If the college could induce 
200 business houses to take one student for a month, and let 
him stay a week or more in each department, they would be 
adding a value to the Economic and Business courses that they 
do not now possess. 



B. From Students 

I. The number of replies to this questionnaire was 546 — 
a large proportion of the total number distributed, certainly 
much over half , although the exact percentage cannot be 
given because a considerable nimaber of students received 
the blanks in several courses. There were 1007 registra- 
tions in Economics courses in March, 1915, which means, 
possibly, 850 individuals, not over 800 of whom could 
have received the questionnaires. The total is large enough 
to provide a good sxu^ey of opinion among students of 
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Economics in the College. The whole niimber was divided 
as follows: 

Students taking Economics A only 308 

Undergraduates taking conrses more advanced 

than Economics A 208 

Graduate students 30 

2. The degrees for which these students were candidates 
were: 

(a) Students taking Economics A only: 

Candidates for A.B 257 

" " " S.B 41 

" " " A.A I 

Not candidates for a degree 4 

Not listed 5 

308 

(b) Undergraduates taking advanced courses: 

Candidates for A.B 185 

" " " S.B 23 

208 

(c) Graduate Students: 

Candidates for A.M 12 

" " " Ph.D II 

Not a candidate for a degree .... i 

Not listed 6 

Of the total number (546), about 80 per cent were 
undergraduates in regular standing. 

3. The classes in which these students were registered 
were: 

(a) Economics A: ^ 

Seniors (1915) 20 

Jimiors (1916) 82 

Sophomores (191 7) 173 

Freshmen (1918) 6 

Unclassified 26 

Spedal I 

308 
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(() Advanced oourses: 

Seniors 80 

Juniors loi 

Sc^homores 33 

Unclassified 4 

208 
(c) Graduate students: 

First Year 30 

Second 6 

Third 2 

Fourth I 

Notstated i 

4. Intention to pursue Economics further is shown by the 
foUowingfigures: 



Undernadttates Undetgradoates 

taking JBconomics taking Advanced Graduate 

Aonly Counes Students Totals 



Yes 132 86 7 225 

No 107 68 6 181 

Undedded . . 51 10 s 66 

Noanswer . . 18 48 12 78 

5. Concentration in Economics was indicated as follows: 

Students taking Students taking 

Economics A only Advanced Counes Totals 

Economics 40 95 135 

Economics and Government .... 14 17 31 

Economics and History 6 8 14 

Economics, Government, and History 5 11 16 
Economics, Philosophy, and Social 

Ethics — I I 

Economics and Philosophy .... — i i 

Totab 65 133 198 

6. Candidates for degrees with distinction in Economics 
appeared as follows : 

Students taking Students taking 

Economics A oiuQr Advanced Courses Totals 

Economics 61 24 85 

Economics and Government .... i 2 3 

Economics and History o i i 

Economics, Government, and History 3 5 8 

Economics and Philosophy .... i 3 4 

66 35 loi 
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7. The occupations into which these students expected to 
go were : 





Students tftkins 
Economics A oo!b^ 


Students taking 


Graduate 






Advanced Courses 


Students 


Totab 


I. Business . . 


68 


92 


— 


l^k) 


2. Law . . . . 


57 


43 


I 


lOI 


3. Teaching . , 


24 


6 


20 


SO 


4. Engineering 


16 


2 


— 


18 


5. Medicine . . 


16 


2 


I 


19 


6. Banking. . . 


13 


12 


I 


26 


7. Chemistry . . 


II 


S 


— 


16 


8. Joumalism 


8 


4 


I 


13 


9. Ministry. . . 


S 


— 


4 


9 


10. Agriculture . 


3 


S 


I 


9 


II. Theatre . . . 


3 


— 


— 


3 


12. Efficiency En- 


- 








gineering . 


2 


X 


— 


3 


13. Mining . . . 


2 


I 


— 


3 


14. Architecture . 


2 


— 


— 


2 


15. Public Servia 


i 2 


— 


— 


2 


16. Consular Ser- 


- 








vice . . . 


2 


2 


I 


5 


17. Advertising . 


I 


— 


— 




18. Politics . . . 


I 


— 


— 




19. Geological 










Survey . . 


I 


— 


— 




20. Biological Re- 


- 








search . . 


I 


— 


— 




21. Electridty . . 


I 




— 




22. U. S. Anny . 


I 


I 


— 




23. Accoimtancy . 


— 


I 


— 




24. Government 










Admin. . . 


— 


I 


— — 





Ninety-six men were undecided: 11 Seniors, 31 Juniors, 
50 Sophomores, i Freshman, 3 Unclassi&ed. Sixty-eight 
of these men were taJdng Economics A only. 

The occupations chosen were divided for certain purposes 
of comparison into two groups — first, the group for which 
Economics is commonly supposed to be preparatory — 
Business and the Law; second, the group for which Eco- 
nomics is not commonly supposed to be preparation — 
Engineering, Medierne, Agriculture, etc. The purpose of 
this division was to see whether students intending to enter 
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the Law or Business expect more direct help from Economics 
courses than do the others. Teaching, Joumalism, the 
Mmistry, Public Service, Consular Service and Politics, 
all occupations in which knowledge of Economics might be 
highly usefnl, were omitted from the coxmt of the second 
group, in order that the contrast, if any appeared, might 
be sharply drawn between the clearly vocational outlook 
and the clearly non- vocational outlook of the students in 
the two groups. When an answer was equivocal it was 
put with one group or the other only when all the possibili- 
ties suggested fell within tKat group. 
The groups compared thtis as to numbers: 





Vocational Non-Vocational 
Group Group 


Neutral 
Group 


Not 
Grouped 


Students taking Economics A only . 


150 57 


42 


59 


Students taking Advanced courses . 


155 18 


12 


23 


Graduate Students 


2 2 


26 






307 77 80 82 

According to this grouping, concentrations in Economics 
and in Economics and other Subjects divide as f ollows : 

NON-VoCAnONAL 
VOCATEONAL G&OUP G&OUP 



as o (3>o r® øso (3^ o "^ 

C/3 CA C/3 CO 



Economics 32 74 106 033 

Economics and Government 9 16 25 000 

Economics and Histoiy . . 4 7 11 o z z 
Economics, Government and 

History z 9 10 o o o 

Economics and Philosophy .0 z z 000 

Concentrations in Economics and in Economics and other 
subjects fall overwhelmingly in the vocational group. As will 
be seen from the table xmder the f ollowing heading, this group 
expects of the instruction help in vocations more f requently 
than does the other, but direct help only about as much. 
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8. The help expected by the students in their several 
vocations may be seen from the f ollowing figures : 



Directly helpful . . 

Indirectly helpful . 

Not helpful .... 

No answer or too 
equivocal for 
record .... 
Totals .... 



a< 

II 

48 

39 



63 
308 



il 



5^ 



els I5 



5 



45 
118 

12 



33 
208 



16 
9 



S 
30 



I 



109 
285 

SI 



lOI 

546 



1 



5l 

> 



67 
216 

19 



S 
307 



I 

r 



so 
16 



4 
77 



1 lå^ 



I 



3S 

19 
16 



.1 



list 



^ 



10 

80 



82 
82 



109 

285 

SI 



lOI 

S46 



Of the whole number of students 73 per cent expect help; 20 per cent direct 
help; 53 per cent indirect. Of the vocational group 92 per cent expect help; 
22 per cent direct; 70 per cent indirect. 

9. The chief reasons given for taking Economics courses 
were: 



9 

■fil 



9 

c 



11 



II 



I 

CO 



1. Expected courses to be directly helpful in 

vocation 25 

2. Expected indirect help through a know- 

ledge of prindples, etc 57 

3. In order to understand elementary eco- 

nomic principles 30 

4. As part of a general education, for informa- 

tion or broader vision 51 

5. For mental training or methods of reason- 

ing 13 

6. For a better understanding of affairs of 

the day 17 

7. For dtizenship, better understanding of 

politics or legislation 11 

8. For a better imderstanding of social 

problems 30 

9. For a better imderstanding of finandal, 

industrial, and legislative problems . . 29 

10. For purely cultural values 10 

11. Because of natuial interest in Economics . 12 

12. To fill out college Schedules 32 



« « fc. 
I 



37 

33 
10 

21 

18 

21 

7 
13 

19 

2 

3« 
9 



1^ 



I I 



il 



8 

a 



S 



3 

2 



2 

3 

16 

o 



70 
92 
40 

73 
34 
40 
19 
49 

SO 

14 
66 

41 
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10. The spedfic reasons for taking particular courses 
could not be distinguished from the general reasons for 
studying Economics. Apparently the students did not 
differentiate clearly between their general purposes ux 
studying the subject and the ways in which special courses 
might serve those purposes. 

11. The advice or information because of which courses 
were chosen appears from the foUowing figures: 

Students taking Students taking Graduate 

Economics A ouy Advanced Courses Students Totab 

Faculty Advisor .23 21 o 44 

Member of the 



8 19 16 43 

I I 03 

I o 01 

8 14 o 22 

9 33 4 46 



Faculty . . 
Senior Advisor 
Tutor . . . 
Relatives . . 
Catalogue . . 
Reputation of the 

Course .... 39 41 4 84 



Total number of statements conceming sources of advice or information 243 

12. The most hdpfid courses in other Departments (with 
respect to the study of Economics) were listed thus: 







Students taking 


Students taking 


Graduate 








Economics A 


omy 


Advanced Courses 


Students 


Totals 


Government 31 




3 




3 


— 


S 


English .... 




S 




— 


— 


S 


Physics .... 




3 




2 


— 


S 


Geology . . . 




2 




3 


— 


S 


History 30 . . 




I 




S 


— 


6 


" 32b . . 




S 




— 


I 


6 


" 32 . . 




— 




7 


— 


7 


Government 17 




I 




6 


— 


7 


Chemistry . . 




S 




3 


— 


7 


Modem Languages 


I 




7 




8 


Psychology . . 




s 




S 


I 


II 


Government 9 . 




s 




7 


— 


12 


English A . . . 




II 




3 


— 


14 


History 10 . . 




7 




9 


— . 


16 


History 13 . . 




8 




14 


— 


23 


Mathematics . 




16 




14 


— 


30 


Government . . 




19 




10 


3 


31 
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Philosophy . 
Social Ethics 
Histoiy . . . 

" I 
Government i 



Students taking 
Economics A on^ 

13 
4 
19 
27 
48 



Students taking' 
Advanced Couises 

16 

23 
23 

23 
26 



Graduate 
Students 

3 
8 

3 

2 



Totab 

32 
35 
44 
52 
74 



13. The reasonsfor this hdpfulness were listed thus: 






2 



1. Answers too general for classification . . 

2. Courses said by student to give training in 

reasoning 

3. Practical application of economic principles 

4. Gave power of expression 

5. Gave power of interpretation 

6. Historical illustrations and applications of 

economic principles 

7. "Supplementary values" 

8. Subject matter — useful as introduction to 

and preparation for Economics .... 

9. Subject matter parallel or identical . . . 

10. Methods useful as introduction to and 

preparation for Economics 

(a) Practice in plotting graphs and diagrams 
{b) Other useful methods not specified . . 

11. Methods parallel or identical 

12. Help obtained from reading 

13. Gave a different point of view 

14. Gave valuable moral or ethical setting . . 

15. Gave general information 



26 

20 
10 
14 

4 

36 
4 

3 
12 



7 
12 

o 

I 
I 



11 1 

O > O 

V 

CO 

25 

8 

14 
8 

2 

39 

I 

3 
IS 



6 

I 
2 

5 
2 

3 






2 
I 



I 
I 



2 
I 



S 



54 

29 

24 
22 

6 

77 
6 

6 
30 



14 

14 

2 

6 

5 

4 

I 



14. The difficulties met in the study of Economics are 
shown by the following summary: 

I. Nature of the course or of the instruction: 

(a) Treatment too theoretical 79 

(() Lack of cleamess in lecture and discussion .... 56 

(c) Lectures not hdpful 45 

(d) Valueless discussion 24 

(e) Course hurried, too much ground covered, more time 

for discussion needed 30 

(f) Disregaxd of other authorities 13 
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2. Lack of fadlities: 

(a) Lack of books for assigned reading 52 

(6) Need of a better textbook 40 

(c) Crowded sections n 

3. Disadvantageous requirements: 

(a) Too large or faulty assignment of reading 45 

(6) Too much thesis work 13 

4. Lack of supervision or effident leadership: 

(a) Need of doser touch with instructors 43 

(b) Need of better section men 42 

5. Miscellaneous: 

(a) Personal incapadty, lack of interest 69 

(() Unsatisfactory or unfair methods of rating scholar- 

ship . 35 

(c) Misunderstanding of nature of course 13 

15. The relative helpfulness of various phases of the 
work in Economics is summarized below. It was possible 
to treat the answers to this question statistically in a 
more elaborate fashion than could be used with the 
other retums. 

Analysis and Interpretation of Retums to Question i j 
of Questionnaire for Under gradtmtes 

The question asked was as f ollows : 

Mark in order (i, 2, etc.) the following phases of the work ac- 
cording to their relative helpfulness to you, beginning with the most 
helpful: lectures; class discussions; assigned reading; reports; labora- 
tory; comments or additional information. 

Practically all the students supplied data on this point. 
The distribution of the relative values (in point of helpful- 
ness) assigned by the entire group is that indicated in 
Tables 1-3. 
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TABLE I 

NuMBEE OP Students Takino Courses in Economics Assignino 
DiFFESENT Positions to Vasious Phases op the Work 

ACCORDING TO THE DeGREE OP " HeLPFULNESS " 

Phase of the Work 

Lectures 

Classroom Discussions i8o 
Assigned Reading . 

Reports 

Essays and Theses . 
lAboratoiy Exercises 
Comments, etc. . . 

Totals .... 



z 


a 


3 


4 


S 


6 


7 





Totals 


97 


148 


214 


42 


15 


4 


3 


4 


527 


i8o 


157 


99 


55 


16 


13 


4 


6 


530 


253 


t8o 


69 


22 


14 


3 





I 


542 


13 


20 


S6 


78 


39 


20 


2 


I 


229 


IS 


14 


sS 


39 


33 


30 


20 


4 


193 


8 


14 


26 


32 


SS 


22 


10 


2 


147 


3 


7 


20 


42 


24 


16 


15 





127 


569 


S40 


522 


310 


174 


108 


54 


18 


2295 




TABLE 


2 













Per Cents op Students Assigning Difperent Positions to 

Each Phase of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



z 

18 

34 

47 
6 

8 

5 

2 



3 
28 

39 

SS 

9 

7 

10 

6 



3 

41 
19 
13 
24 
20 
18 
16 



4 

8 

10 

4 

34 
20 

22 
33 



5 

3 

3 

3 

17 

17 
22 

19 



6 

I 

3 

I 

9 
16 

15 
13 



7 

I 
I 
O 

I 
10 

7 
12 



o 
I 

I 
O 

I 

2 
I 
O 



TABLE 3 

Per Cents of Different Positions Assigned to Difperent 

Phases op the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exercises 
Comments, etc. . . 



z 

17 
32 

45 

2 

3 

15 
o 



27 

29 

33 

4 

3 

3 

I 



3 

41 

19 

13 
II 

7 
5 
4 



4 

14 
18 

7 

25 

13 
10 

I 



5 

9 

9 
8 

22 

19 
19 
14 



6 

4 
12 

3 

19 
28 

20 
15 



7 

6 

7 
o 

4 

37 

19 
28 



o 

22 

SS 

6 

6 

22 

II 

o 



From these figures a nmnber of things are apparent: 
I. That in the opinion of the undergraduates various phases 
of the work in Economics rank in order: (i) Assigned reading; 
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(2) Classroom discussions; (3) Lectnres, etc. II. Apparently 
the other phases of the work are relatively less helpful to 
the students as a whole. III. While these retums can 
represent only the opinions of the students, it is nevertheless 
true that the success of any of the phases of the work is 
conditioned by the attitude which the students assume 
toward it, and therefore the attitude of the students as 
indicated by these retums is important. IV. The retums 
are of coiurse affected by the usual factor of individual 
differences and the faet that a fairly large proportion of 
the students can be f ound assigning first place to any of the 
three important phases indicates the supplementary nature 
of those three phases in class work. 

Since it is possible that somewhat advanced students in 
Economics may well find a phase of the work particularly 
helpful which may be less helpful to the younger students 
who have not taken work in Economics previously, a 
comparison of the distributions in Economics A alone and 
in other courses in Economics may indicate some important 
differences. The distribution of assignments of value for 
Economics A alone is presented in Tables 4, 5, 6, and for 
students in all other classes in Economics in Tables 7, 8, and 
9. Perhaps the only important difference is to be foimd in 
the faet that the order of helpfulness for students in Eco- 
nomics A alone is first, assigned reading, second, classroom 
discussions, and third, lectures; whereas for students taking 
advanced courses the order of the relative importance is 
first, assigned reading, second, lectures, and third, classroom 
discussion. In other words, for advanced students ap- 
parently the lectures are of much greater value than is the 
case with the students beginning the study of Economics. 
This is shown very definitely in the percentile distribution 
of tables. 
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TABLE 4 

NuMBER OF Students Taking Economics A Assigning Ddpfesent 
PosmoNS TO Vakious Phases of the Wosk Accosding 

TO THE DeGREE OF "HeLFFULNESS" 

Phase of the Work 123 45670 Totals 

Lectures 24 63 172 30 6 2 2 4 303 

Classroom Discussions .... 134 125 44 12 o 3 o 3 321 

Assigned Reading 164 112 29 3 7 i o i 317 

Reports 2 2 19 26 iz iz z o 72 

£ssa3rs and Theses z 3 7 7 8 Z3 zo 2 5Z 

Laboratory Exerdses 3 5 zz zo Z3 4 3 2 5Z 

Comments, etc 3 6 zs 33 zo 4 4 o 75 

Totals 33Z 3z6 297 Z2z sS 3^ 20 i« iiQO 



TABLE S 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 

Phase of the Work 12345670 

Lectures 8 2z 57 zo 2 z z z 

Classroom Discussions . 4Z 39 Z4 3 o z o z 

Assigned Reading ... 52 35 9 z 2 o 00 

Reports 3 3 26 36 zs zs z o 

Essays and Theses ... 2 6 Z9 Z4 z8 26 20 4 

Laboratory Exerdses . . 6 zo 22 20 26 8 64 

Comments, etc 4 82044Z3 s 5o 



TABLE 6 



Per Cents of Different Positions Assigned to 
Different Phases of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essa3rs and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



7 
40 
SO 

i 
o 

i 
z 



3 
20 

35 
i 

z 

2 
2 



3 

S8 

IS 
zo 

6 

2 

4 
S 



?S 
zo 

3 
22 

6 

8 

28 



5 

zz 
o 

13 

20 

IS 
24 
18 



S 
8 

3 
29 

34 
zi 

zo 



zo 
o 
o 

s 

so 

IS 
20 



33 

2S 
8 

o 

17 

17 
o 
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TABLE 7 
NuMBER OF Students Taking Advanced Coxtkses in Economics 

ASSIONING DiFFESENT POSTTIONS TO VaEIOUS PhASES OF 
THE WOSK ACCOSDING TO THE DeGKEE OF " HeLPFULNESS " 

Phase of the Work i 334 5670 ToUb 

Lectures 73 85 43 13 9 2 10 234 

Classroom Discussions .... 46 32 55 43 16 zo 4 3 309 

Assigned Reading 89 68 40 19 7 3 00 335 

Reports 11 18 37 s* 38 9 11 157 

Essays and Theses 14 11 31 33 35 17 10 3 143 

Laboratory Exerdses 5 9 15 33 30 18 7 o 96 

Comments, etc o i 5 9 14 Z3 iz o 53 

Totals 338 324 325 Z89 119 70 34 6 1105 



TABLE 8 

Per Cents of Students Assionino Diffexent Positions to 

Each Phase of the Wosk 



Phase of the Work 



Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc . . 



33 
33 

40 

7 
10 

5 
o 



38 
IS 
30 

13 

8 

9 

3 



3 

19 
26 

z8 

24 

33 
16 
ZO 



5 

3Z 

8 

33 
23 
23 
17 



4 
8 

3 
z8 

18 

21 

27 



z 

5 

z 

6 

13 

19 
23 



O 

3 
O 

I 

7 
7 

3Z 



O 

3 
O 

I 
I 

o 
o 



TABLE 9 
Per Cent of Diffesent Positions Assigned to 

DiFFERENT PHASES OF THE WORK 



Phase of the Work 

Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essa3rs and Theses . 
Laboratory Exerdses 
CommentSi etc. . . 



31 

19 

37 

S 
6 

2 

o 



38 

14 

30 

3 

S 

4 



19 
24 
18 

16 

14 

7 
3 



4 

6 

33 
ZO 
28 

17 
12 

S 



5 

8 

14 
6 

24 

3Z 

17 
Z2 



3 

14 

3 
13 
24 
26 

17 



3 

13 
O 

3 

29 

2Z 
32 



O 

so 
o 

17 

33 
o 

o 
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A further question of interest is whether the better stu- 
dents assign a diff erent order of values to the various phases 
of the work. Hence, m Tables lo, ii, and 12 is presented 
the distribution of assignments of value for advanced 
students in Economics whose previous work in Economics 
had averaged better than C. It is clear that the order of 
values for the better group of students is apparently lectures 
and assigned reading bidding for first place, with classroom 
discussion a bad third, essays and theses showing a possible 
gain over the distribution in the general group. 



TABLE 10 

NuMBER OF Students Taking Advanced Cousses in Economics Assigning 
DiFFESENT Positions to Vaeious Phases of the Wosk According to 
the Degree of "Hei:pfulness" — Better Students Only 



Phase of the Work 

Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exercises 
Comments, etc. . . 
Totab .... 



31 

14 

32 

6 

9 

I 

o 
93 



31 
8 

31 
9 

S 

4 
o 

88 



3 
12 

IS 
12 

16 

7 

I 
88 



4 

8 

17 
8 

17 

13 

7 

3 

73 



3 
9 

3 

II 

8 

9 

4 

47 



o 
6 
o 

2 

5 

9 
6 

28 



7 

O 

2 
O 
O 

I 

5 

2 

10 



o 

2 
O 
O 
O 
O 
O 
2 



Totals 

8S 

83 

89 

57 

57 

42 
16 

429 



TABLE II 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 

Phase of the Work za 345670 

Lectures 37 37 14 9 4 o o o 

Classroom Discussion . . 17 10 30 21 iz 7 3 3 

Assigned Reading ... 36 35 17 9 3 o 00 

Reports 11 16 21 30 19 3 o o 

Essays and Theses ... 16 9 28 23 14 9 20 

Laboratory Exercises . . 2 10 17 17 21 21 12 o 

Comments, etc o o 6 19 25 27 13 o 
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TABLE 12 

Per Cents of Diffesent Positions Assigned to Diftesent 

Phases of the Work 



Phase of the Work 1334 567 

Lectnres 

Classroom Discussion 
Assigned Reading . 



Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



33 35 U " 6 o o o 

15 9 28 23 19 21 30 100 



34 35 17 II 6 o o o 

7 10 14 23 23 7 o o 

10 6 18 18 17 18 10 o 

I S 8 10 19 32 so o 

o o I 4 9 21 20 o 



Since the relative values of the various phases of the 
work of the conrse differ not only for individual students, 
but also for individual instnictors, an analysis of the dis- 
tribution of values assigned by students in Economics A 
is of particular interest. Here the important phases of the 
work are apparently lectures, class discussions, and reading. 
Since the lectures are the same for all, and the assigned 
readings are the same for all, interest centers particularly in 
the question of the relative value assigned to class discussion. 
Taking the group as a whole and considering only these three 
phases of the work we find that classroom discussion is 
assigned first, second, and third piaces in the proportion 
indicated in the table following. By using this as a rough 
standard for the entire group we may compare with that 
standard the relative value assigned to class discussion (the 
sole variable factor) as it appears in the retums by students 
separated according to the instructor concemed. These 
distributions are indicated in Table 13. 
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TABLE 13 

DisTKiBinioN OF Class Discussion Assigmments of Value (in Point 
OF Helffulness) by Students of Economics A (1914-1915) 

ACCOSDING TO THE InSTRUCTOR InvOLVED 

Number of Per Cent of Stadents Assigning Positions 

I 1 3 



All 322 42 39 18 

Y 31 39 48 13 
X 61 49 43 8 

W 54 57 37 6 

V 24 25 50 25 
U 44 41 41 18 
T 50 28 40 32 
S 22 18 64 18 

From this table it would appear that it is quite possible 
that instructors W and X are highly effident in the conduct 
of classroom discussion, that instructors U and Y have a 
fair degree of success, and instructors S, T, and V are rela- 
tively iinsuccessful in the classroom discussion. However, 
since relativdy smaU nxunbers are involved, the table should 
be suggestive for self-examination rather than for dogmatic 
assertions conceming the relative efl5ciency of the dassroom 
discussion as conducted by the various instructors. 

16. The problems met in life^ to which instruction in 
Economics was considered related, were stated in such 
general terms that the answers in this colxmm have very little 
value, except to confirm the testimony on lack of practical 
applications. They are smnmarized below. Although the 
students are interested in very specific problems, m their 
statements conceming which they of ten show the influence 
of instruction they are receiving in courses in Economics, 
they interpreted the question conceming the relation be- 
tween instruction in Economics and problems of life in an 
entirely general fashion. 

1. General affirmative answers 89 

2. Negative answers 122 



i6o 
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3. Spedfic help in vocation 6 

4. Indirect help in vocation 20 

5. Understanding of fundamental economic prindples 3 

6. Better general education and information 5 

7. Training in reasoning .... i 9 

8. Gave broader Outlook 14 

9. Gave political insight and information 3^ 

10 Better understanding of social problems 39 

11. Better understanding of economic problems other than social 56 

12. Better understanding and power to judge current affairs 4^ 

13. Better understanding of economic terms i 

14. Avoid current fallacies 4 

15. Understanding banking and investment problems 16 

16. Helpful in accounting 3 

17. Helpful in accounting 2 

18. Cultural values i 

19. Purchasing of commodities 3 

20. Help in arranging Sunday School dass work i 



17. The movements or problems of the day in which the 
students prof essed themselves interested were : 



Labor problems, unemployment, 
tråde imionism, capital and la- 
bor, etc 61 

Sodalism 53 

Taiifif, protection, free tråde ... 32 

Peace, disarmament 24 

Woman suffrage, feminism ... 22 
Problems of banking, finance, and 

currency 18 

Prohibition 17 

Immigration, race problems ... 17 

Rural and agricultural problems 17 

South American tråde 16 

The war, and its social and eco- 
nomic effects 15 

Problems of business oiganization, 

development, and regulation . . 14 

Educational problems 14 

Single taz 14 

Problems of govemment and 

politics 14 

Mimidpal administration, dty 

planning 13 

Taxation 13 



Social reform in general 12 

Public ownership and regulation 12 

Preparedness n 

Public health, sanitation, housing 10 
International tråde, law, and rela- 
tions 8 

Trust legislation 7 

Railroad problems 7 

Religions problems 6 

Conservation. 6 

Distribution of wealth 5 

Industrial devdopment and effi- 

dency $ 

Eugenics, sex problems 5 

Co6perative enterprises 5 

Land values and land titles ... 5 

Penology and prisons 5 

The negro problem 4 

ChUd labor 2 

Pure f ood 2 

Charities sndphilanthropy. ... 2 

Juvenile courts 2 

None 7 

Many, all, in general 29 
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1 8. Suggestions and criticisms may be smnmarized as 
follows: 

alf isSS 1 8 




Sections and Assistants ^^ 

1. Poor personality and poor teaching ability 31x5 

2. Hold aloof. Do not appreciate students' 

point of view 3 17 i 21 

3. Hair-splitting distinctions and technical 

phraseology i i i 3 

4. Impossible to get clear outUnes or well- 

defined ideas i 

5. Fewer sections and more lectures .... 5 

6. Fewer lectures and more sections .... iz 

7. Sections too large 6 

8. Double A section undesirable 3 

9. No instruction on "how to study". ... 2 

10. Too much emphasis on the text 4 

11. Time not properly allotted 2 

12. Discussion ill directed. No limit on talk- 

ative members 3 

13. Written questions not discussed in dass . 2 

14. Reasons for failure not explained .... i 

Lectures 

1$. Too theoretical 13 

16. Better lectures desirable 5 

17. Lectures follow book too closely .... 24 

18. Object to textbook 3 

19. Wish views of other economists 6 

20. Suggest speakers outside department . . 4 

21. Lectures not correlated with reading (See 

also 42 below) i i — 2 

22. Lectiires and discussions do not darify 

reading 3 i — 4 

23. Too much superfluous matter 4 2 — 6 

24. More time on first chapters of book ... 3 — — 3 

25. More careful choice of topics 2 2 2 6 

26. Too many qualif3dng expressions .... 2 i — 3 

27. Treat protection and free tråde together .2 — — 2 

28. Hard to hear the lecture 6 — — 6 

Examinations and Tests 

29. More just and uniform marking system .6 4 3 Z3 

30. General review to precede examination .4 i — 5 
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Examinaiiofu and Tests ^' 

31. Too much emphasis on tedmical terms .3 i — 4 
33. Questions on historical rather than eco- 

nomic view 2 — — 2 

33. Too little time on tests 5 2 z 8 

34. Too much weight on mid-years and finals 12x4 

35. More numerous pi^rs, tests, and reports 5 6 — 11 

36. Tests too easy i — — i 

37. Questions asked for too much detail, lay 

too much stress on memory and offer 

no choice 3 — — 3 

Theses 

(Sec also S4, SSf S^ below) 
33. Requirements burdensome i 

39. More theses should be required 3 

Reading 

40. Assign more outside reading 5 

41. Reading requirements burdensome ... 2 

42. Reading poorly correlated with lectures . 7 

43. Allow more general and require less spedfic 

reading 3 

44. Critidsm of individuals i 

General Suggestions 

45. More printed questions 5 

46. Catalogue gives wiong impression .... 3 

47. Abolish oral examinations 2 

48. More contact, advice and hdp from pro- 

fessors 5 

49. More discussions and debates 14 

50. Open Economics A to freshmen 2 

51. Discuss current periodicals in dass ... — 

52. No material for thesis assigned — 

53. Theses should be more carefully supervised — 

54. Thesis subject too remote from the general 

topic — 2 — 2 

55. Economics Department suggest gioups of 

studies in Economics for certain pro- 
fessions — — I 

56. Standardized principles ezpounded in z 

sections — 3 z 4 
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Favorable comments are frequent, as the following 
excerpts show. Favorable comments on individual instnic- 
tors are often enthusiastic. 

Students taking Economics A only. 

Economics A, Twenty-six men speak favorably of this course 
and those who give it. The followmg are some of the comments: 
"Well nm"; "admirably conducted"; "very good indeed"; 
"mechanically perfect"; "course is intelligently and efficiently 
håndled"; "best run of all the large courses"; "the most eflS- 
ciently conducted of any of the courses I have taken"; "tech- 
nically above reproach." One man is so pleased with the course 
that he dedares "it should be made compulsory." 

Students taking Advanced Courses and Gradimte Students. 

Twenty men speak very favorably of the courses they have 
taken. 

Economics A, "Well conducted"; "the most nearly perfect 
course in college — the theories can be grasped and bluffing doesn't 
count"; "I have nothing but praise for Economics A; the dass 
discussions are particularly stimulating"; "sensibly conducted"; 
"of great value"; "the honor section is fine." 

Other courses. " Economics 3 is well conducted " ; " Economics 9 
is extremely stimulating"; "Economics 5 and Economics 6 are 
well conducted"; "Economics 11 is one of the best courses I ever 
took"; "Economics 11 is the best course on account of the train- 
ing in reasoning." 

Comment on the Department in General. "Well satisfied with 
the Economics Department"; "courses are conducted in a very 
efficient, sensible way"; "the Economics Department seems the 
best conducted of any department." 

These suggestions and criticisms are often put with a 
force to which the simMnary given above cannot quite do 
justice. The following summary taken directly from the 
replies is therefore added. 



164 THE TEACHING OP ECONOMICS 

Section Meetings and Assistants 

More criticisms are made by students on this subject than 
on any other single point. Much strenger feeling is evi- 
denced by advanced and graduate students than by those 
taking Economics A only. Twenty-nine men from the first 
group and ten from the second (39 in all) make specific and 
severe accusations against the personality and teaching 
ability of assistants. They state that these instructors 
appear to have been chosen for high marks in Economics 
coiurses and not for their fitness as teachers, that they hold 
themselves too much aloof from the students and do not 
try to appreciate the student point of view, that they are 
unfair in their judgments and f ail to be helpful in presenting 
the work or in stimulating discussion, and that they tend 
toward hairsplitting distinctions and technical phraseology. 
Graduate students are particularly opposed to the type of 
assistant often chosen. 

Fourteen replies mention various ways in which the section 
meetings are not systematically conducted. They refer to 
the lack of specific planning of the work and say that it is 
impossible to get clear outlines or well defined ideas from 
the instruction given. 

Ten advanced and graduate students think that dis- 
cussions are frequently too "fine spun/' are not properly 
directed, do not hold the attention of the class, are vague, 
technical, and do not clarify the questions raised. 

The suggestion is made by four men that some means 
should be taken to standardize the principles expounded in 
the sections. They cite instances where the instructors 
have differed with professors on important issues and have 
thus confused the classes by injecting their own opinions. 

Five men believe that there should be f ewer sections and 
more lectures, but there are on the other hånd thirteen replies 
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which consider the lectures of Economics A a waste of time 
and demand more section meetings. 

Eight men object to the size of the sections and think 
that better discussions could be had in smaller groups. 

Two men mention the AA section as especially midesirable 
and think that it should be abolished. 

The following criticisms of methods in section meetings 
seem to be worth considering. 

1. There are no lectures on how to study and little instruc- 
tion in methods of coUecting material, using Ubrary faciU- 
ties, etc. 

2. The sections emphasize the text to the exclusion of 
other important matters. 

3. Too much authority is given to assistants in assigning 
reading, resulting in irregular assignments. 

4. Where laboratory sections are required, the amoimt 
of outside reading is not decreased and the requirements are 
burdensome. 

5. There is not always time to finish the problems assigned 
during the laboratory period. 

6. The laboratory assistants are careless in checking up 
the work of the students. 

7. Proper time allotment in the sections is often seriously 
neglected. 

8. Discussions are not well directed, do not include enough 
students, and no limit is placed on talkative members. 

9. The subject is not developed in new forms and interest 
is not aroused. 

10. Too many puzzling questions are asked and textbook 
answers are expected. 

11. Written questions are not discussed in class. 

12. No definite explanations are given of the reasonsfor 
f ailure so that the student can avoid futiure blunders of a 
similar sort. 
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13. There is no uniform standard of requirements. The 
suggestion is made that the professors take sections in tum, 
thus giving the students a share of their time. 



Lectures 

The practical application of the courses is a matter which 
probably touches all the teaching in the Department, but 
seems especially important in connection with lectures, 
since the attitude taken by the professors in their lectiures 
largely determines the trend of discussions and the character 
of written work. Thirty students in Economics A and 
thirty-three advanced and graduate students (sixty-three 
in all) believe that the courses are too theoretical, lack in 
concrete illustrations, and are not sufficiently applied to 
current, social, political, and financial problems. 

Twenty-six men in Economics A object to having the 
lectures follow the textbook so closely. A considerable 
number of these object to the book itself. Sixteen men 
would like to have the views of other economists presented 
in Economics A. Many wish that speakers from other 
departments or from the business world might be heard. 

The foUowing seem to be the most important suggestions 
conceming the conduct of lectures. 

1 . Correlation between reading and lectures is not always 
apparent. Lectures and discussions do not clarify or 
properly criticize the required reading. 13 repUes. 

2. There is too much superfluous matter in Economics A 
and the <:ourse is confusing because of the large amount of 
material and the detail accompanying it. 6 replies. 

3. More time ought to be spent on the first chapters of 
the book. The work of the first few weeks is theoretical 
and leaves a confused impression. 3 replies. 

4. More careful choice should be made of the parts to be 
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treated in the lectiires. Only the more difficiilt portions 
need to be discussed. 2 replies. 

5. There are too many qualifying and limiting expressions. 
Students are confused by them. 3 replies. 

6. No outline or smnmary is provided. Statistical 
matter is not put on the blackboards or distributed on 
mimeographed sheets. 6 replies. 

7. Protection should be taken up simultaneously with 
free tråde so that the two may be contrasted and compared. 
Let students choose for themselves on such questions. 

8. The lecture cannot always be heard distinctly. 3 
replies. 

9. Lectures cannot be heard in the rear of the gallery. 

3 replies. 

Examinations and Written Tests 

1. A more uniform and just system of marking is needed. 
10 replies. 

2. A general review preceding examinations would be 
helpful. 

3. The method of grading graduate students leads to 
cramming and decreased real productive work and clear 
thinking. 

4. Assistants expect students to use a certain phraseology 
in their answers which induces mimicry and discounts 
independent expression. Too much emphasis is placed upon 
technical terms used nowhere save in Economics courses. 

4 replies. 

5. Questions are asked from the historical rather than the 
economic viewpoint. 2 replies. 

6. Too little time is given for the short tests. They are 
an unfair basis for judging abiUty. Foreigners especiaUy 
find great difficulty m getting anything written on questions 
proposed. 6 repKes. 
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7. Too much stress is laid upon mid-year and final 
examinations. 4 replies. 

8. There ought to be more nxunerous papers, tests, and 
weekly reports. 8 replies from Economics A. 

9. Questions ask for minute detail, lay too much stress on 

memory, and there is no choice of questions. 5 replies, 

Economics A. 

Theses 

1. Thesis work is overdone and the requirements are 
burdensome. 19 replies. 

2. Thesis was assigned on which no material was available. 
3 replies. 

3. More help and advice ought to be given on the first 
thesis. All theses should be more carefully supervised. 
Professors are disappointing in the interest shown in gradu- 
ate students. 4 replies. 

4. Theses and reading requirements overlap. 

5. The assigned subject was too remote from the general 
topic. 

6. Theses in the different courses ought to be coordinated. 

Reading 

1. Assignments are irregular so that students cannot plan 
their work well. 

2. More outside reading should be assigned in Economics 
A. 7 replies. 

3. The requirements are burdensome in some coiurses. 

4. Reading is not weU correlated with lectures and dis- 
cussions. 12 replies. 

5. Allow more general and require less specific reading. 

General Suggestions 

I. The printed questions are very helpful. There ought 
to be more of them. 3 replies. 
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2. The catalogue gives the wrong impression in regard 
to Economics courses. Students are led to believe that they 
are practical courses. 

3. Ventilation is poor in some rooms. Massachusetts 
HaU is a very unpleasant place in which to work. 

4. Current periodicals should be read and discussed in 
class. 

5. Oral examinations ought to be abolished. 2 replies. 

6. More advice and help from the professors is needed. 
More personal contact ought to be secured through con- 
ferences. 16 replies. 

7. There ought to be more emphasis upon discussions and 
debates. 29 replies. 

8. Open Economics A to Freshmen and give a course 
especially suited to them so that men can decide earlier 
where they wish to concentrate. 

III. General Discussion 

The outstanding faet about both these sets of replies is 
their variety. The accomplishment of the alimmi, taken as 
a body, and the seriousness and directness both of the alumni 
and of the students, as also the definiteness of their views, 
would give one respect for a concensus of their opinions; 
but it is hard to find any real concensus of opinion in their 
answers. One must be content to note tendencies, and to 
take individual suggestions for what they may be worth. 
This is probably the common experience with repUes from 
questionnaires. 

About half (58 per cent) of the graduates are in Business 
or the Law; about half (54 per cent) of the students intend 
to go into Business or the Law. Of the graduate group in 
Law and Business 35 per cent found their instruction in 
Economics actually helpful; of the undergraduate group 
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intending to enter these occupations 22 per cent expect to 
find their instruction in Economics directly helpful. Educa- 
tors, journalists, ministers, and farmers find the coxirses 
vocationally valuable quite as of ten as do business men and 
lawyeirs; and the graduates as a whole find their work in 
Economics quite as valuable for "general culture" as they 
do in their vocations. The proportion who note specifik 
social and cultural values is sxirprisingly small. On the 
whole, the expectations of the students are not imwarranted 
by the experience of their elders. The coimt on values 
shows, however, how difficult it is to differentiate one value 
from another — or how imused men are to the attempt. 
Perhaps it shows also the lack of definite objectives in the 
instruction and of full information on the part of students 
conceming their teachers' aims. It is a striking faet that 
the replies conceming specific reasons for choosing par- 
ticular courses could not be distinguished from those con- 
ceming the choice of Economics as a field of college work. 
This faet is not imrelated, moreover, to the faet that these 
students foimd it impossible to make clear the connection 
between their courses and specific problems met in life. 

The evidence as to the values of instruction in Econom- 
ics thus shows no very exact conception of the bearing of 
the subject on the activities of men. Twenty per cent of 
the alimmi make definite confession of their inability to 
discover tangible results from their study of Economics or 
to give concrete examples of its value. The preponder- 
ance of testimony to the eflfect that Economics had proved 
of value in "other, more general phases of life," rather than 
in vocations or in "social, civic, or economic activities out- 
side vocation" — (vocational values foimd by 42 per cent 
of alumni, social-civic values by 26 per cent, general values 
by 64 per cent) — implies the same vagueness. This em- 
phasis on "general" values runs through all the vocational 
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groups: of the lawyers, for example, 54 per cent make no 
comment on vocational values, and 67 per cent make no 
ccHnment on social-civic values; whereas 70 per cent find 
general values. Fourteen per cent of the lawyers confess 
confusion of mind as to values. A simflar showing appears 
from the testimony of the manuf acturers : 44 per cent make 
no comment on vocational values, 83 per cent make no 
comment on social-civic values; whereas 67 per cent find 
general values. The tendency to credit the study of Eco- 
nomics with a "disciplinary" effect on the mind may well 
be another evidence of inability to discover specific appli- 
cations. Sixteen per cent of the lawyers mention general 
discipline and many of the alumni, of all groups, use phrases 
implying belief in it. Although one who sees quite clearly 
the connection of instruction in Economics with definite 
objectives in the careers and interests of men may neverthe- 
less see also a general effect of such instruction in widening 
mental perspective and fixing habits and ideals of intellec- 
tual thoroughness, still the imqualified ascription of "disci- 
pKne" to instruction in any subject is not imlikely to mean 
that the student is imable or imwilling to discover just what 
use he has made of the facts, the principles, the ideals, the 
points of view, or the methods he acquired from his study. 
At any rate, there can be no reasonable question of the faet 
that the alimmi are imcertain as to the direct applications 
of what they secured from their courses in Economics, 
whether they accoimt it knowledge, insight, power, or what- 
ever else. 

Surely these facts afford a safe basis for effort to define 
more clearly the aims of college instruction in Economics. 
A sharper differentiation of objective between course and 
course can but render each course the more effective for its 
special purpose. This is as true of general courses as of 
others — and it is to be noted that there is some demand 
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for general courses even at the expense of the more special- 
ized courses. If both teacher and pupil understand that a 
given course aims solely at general intelligence conceming 
economic facts and forces and that the course involves 
neither practical training nor the full discussion of special 
economic problems, there can be no disappointment or con- 
fusion if the course does not result in the development of 
special abilities or settled opinions on particular issues. 
But ought there not to be certain courses which do secure 
these results? Or, as it is more important still to ask, if 
courses are already given which seem clearly to f avor prac- 
tical and definite results, ought not these courses to be 
more openly set apart from the "cultural" and "distribu- 
tive" courses and combined into concentration Schedules 
for specific purposes? The alumni testimony conceming 
courses the writers "wish they had taken" is eloquent on 
this point. They wish they had taken courses of a practical 
character and evidently regret that they were not advised 
to do so. Since their time, to be sure, the Department has 
made much progress in this matter. There is a group of 
courses annoimced imder the caption "Applied Econom- 
ics," and the departmental Schedules for concentration and 
the degree with distinction now distinguishes specialization 
in Applied Economics from specialization in Economic 
Theory or Economic History. But there is not enough 
emphasis on the aims to be achieved in such courses or such 
Schedules. The academic distinctions between graduate 
and imdergraduate courses confuse the issue, and the de- 
scriptions of the courses do not suflSciently inform the 
student of the results he may expect. The present (191 7) 
offering of the Department is rich in special courses, but 
almost entirely lacking in any open statement as to their 
usefulness, either singly or in combination, for any possible 
purposes of the student. 
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All this is but to say that the replies to the questionnaires 
support the contentions of Chapter II, above, on Aims. In 
much of our college instruction we are ignoring the purposes 
and needs of the students in order to carry out theories 
which have never been openly discussed. We are insist- 
ing on academic distinctions involving issues never brought 
to the surface. The theory of formal discipline interplays 
in our work with the theory of general culture and the theory 
of special training, but we have no clearly defined scheme 
for achieving different values by definite means and in 
definite combinations of courses. 

The replies to the questionnaires give very strong support 
to the conclusion that the instruction in Economics f aUs to 
bring the student into close enough contact with economic 
data outside of books. Probably this criticism applies more 
to the past than to the present, and it may be voiced less 
often by the "brilliant" student (who most readily fills 
words with content) than by his less theoretically-minded 
fellows. But among students as among alunmi, the most 
frequent criticism is that courses are "too theoretical" or 
"lack practical application." The root of the objection to 
yoimg section men lies quite as much in the faet that they 
do not "know the world" as it does in the faet that they 
are interested primarily in their graduate studies. The 
whole trend of the suggestions and criticisms is in f avor of a 
closer connection between study and "life." The change 
desired is a change of emphasis, a change in the choice of 
illustrative materials and problems, and a change in modes 
of presentation. It is as desirable in general courses as in 
others and might be brought about without adopting any 
settled policy as to practical training. 

The retums conceming advice on the selection of courses 
help to confirm the conclusion that the purposes of students 
are too often ignored. Only a little over half of the students 
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replied on this point, and of these one-third took courses on 
theii: reputation, one-sixth on information from the cata- 
logue. Only a third of these students chose courses on ad- 
vice or information from members of the Faculty. 

Taken as a whole these retums from the questionnaires 
are convindng as to the need for an adjustment of college 
instruction to the aims and desires of our college popula- 
tion. We suffer still from the tradition that a college edu- 
cation is a preparation solely for a lif e of cultured leisure or 
else exclusively for the leamed professions. It would be 
luifortimate indeed if we were to break with the past too 
abruptly or give up the aims and methods which have stood 
the test of time. But if we are to maintain the American 
college as an institution wherein fully half the students are 
to become business men, scientific workers, govemment 
officials, farmers, and the like, our views of college instruction 
cannot remain as simple and imcritical as they still are. We 
need not ignore the general purpose to help every college 
student to be an inteUigent himian being and a good citizen; 
indeed we must emphasize that purpose : but we can no longer 
def end imduly academic teaching nor pressure toward " schol- 
arship" as such, on the groimd that it is "good" for every 
student. We cannot treat students abstractly as "individ- 
uals." What they intend to do in life must have some 
weight with us when we advise them and when we frame the 
courses and Schedules they are to pursue. We must build 
up a more complete and organic aim for college teaching, 
based on fuller knowledge of our pupils and the uses of our 
instruction. 

In spite of the faet that there is a wide scattering of 
opinion in the replies to these questionnaires, a careful study 
of the retums shows how heavily they are weighted with the 
desire for instruction which shall challenge the student to 
greater interest, effort, and response. It is the artificiality 
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and remoteness of coUege work with which there is most dis- 
content. Because students want the subject to be brought 
home to them, they call for closer contact with professors, 
for more experienced assistants, for lectures by business men, 
for more f requent reference to current events, and for most 
of the rest of the great variety of things they consider desira- 
ble. Through all the lists and tables of this chapter, there 
runs a note of appeal for the closer adaptation of college work 
to the needs and purposes of the individual student. 



CHAPTER VI 

METHOD 

I. The Place of Method in College Teaching 

There are no universal criteria of correct method in teach- 
ing, for teaching has no single character which can be so 
analyzed as to yield a fixed "form" or a set of technical 
mles applicable to every lesson or exercise. Principles of 
teaching are like principles of conduct or of style: they 
are statements conceming the nature of means and ends and 
of the adaptation of one to the other in the whole course of 
the teacher's work. Teaching, to be sure, must be judged 
at every point by its eflfects on the student; no method can 
be def ended merely because it suits a piupose of the teacher 
other than the purpose to promote the process of leaming 
in his pupils : but the process of leaming, liberally considered, 
has so many parts and aspects and is so variously conditioned 
by the difiEering aims of the different subjects, by the dififering 
circimistances of difiEerent schools, classes, and periods, and 
by the differing capacities of individuals and groups, that 
the method of a given exercise can be judged only in its 
relation to the total activity of which it forms a part. It is 
one contact among many between the mind of the instructor 
and the minds of his pupils. If it is weU conceived and 
properly carried out, it forwards in some appreciable degree 
and in some particular way the student's progress in the 
subject. Only in the light, therefore, of an intimate and 
comprehensive knowledge of the complete plan of a course 

— the whole complex interchange between instructor and 

176 
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students — can the method of a class hour be justly 
viewed. 

For these reasons this chapter must be impersonal and 
without specific application. It can only set forth in general 
terms the problems of method in college teaching as this 
Inspection has presented them anew and from a different 
angle to the members of the Division of Education. It 
must accordingly risk the charge of being purely theoretical : 
but it is not in faet the expression of a theory ; rather it is an 
objective description and discussion of the factors in a 
general problem as they have been strikingly impressed on 
our minds by our visits to classes in the various Economics 
courses, by the examination of class papers, outlines, and 
reading lists, by the comments of graduates occasionally 
consulted, by the careful analysis of examinations, by 
systematic reports on the study-habits of certain imder- 
graduates, and by the retums to the questionnaires. We 
found it impossible to investigate single courses so fully as 
to f eel justified in offering personal reactions on the methods 
of individual instructors; and we should have hesitated 
in any case to do so because of our lack of systematic 
knowledge of the subjects taught. In spite of the cordial 
invitation of the Department and of individual instructors 
to visit fully and to make our suggestions direct and personal, 
we can in consequence present only impersonal impressions 
and general conclusions. 

It must be admitted that a treatment of this sort will 
have practical value only according to the extent and serious- 
ness of the critical attention it causes to be focused on the 
factors of instruction most in need of it. What these factors 
are, in all its courses or in any, the Department of Economics 
can itself best determine. The Department can also best 
determine how to secure for these factors a new or an added 
emphasis. As we now see the problem, the submission for 
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departmental consideration of complete plans for courses, 
and visits by departmental committees, with frank dis- 
cussion of the resnlting impressions, suggest themselves as 
the best means for inducing wholesome experimentation in 
method; but it goes without saying that such action can be 
useful only when it is imforced, welcome to the instructor 
by reason of a genuine interest in its ends, and productive of 
no hasty eflfort to adopt methods or devices not fully incor- 
porated in the whole scheme of the instructor's teaching. 
Permanent improvement in method must be based, we 
believe, on careful experiment with selected factors in 
teaching, seen in their relation to other factors; and this 
view we have tried to embody in the f ollowing discussion of 
our data in this field. 

To secure these data we visited 25 classes, including 
20 lectures or general class-meetings, and 5 section-meetings. 
Reports of these visits were filed at once, and later con- 
sidered as a group and in connection with the data from the 
questionnaires and the other sources. The visits were made, 
for the most part, during the academic year 1914-15, 
especially in November and December, 1914, and January, 
191 5; also in the early weeks of May, 1914. They brought 
us into contact with the work of nearly all the imdergraduate 
courses then in operation, specifically, Economics A, 1% 2*, 
3j Sj 6% 8, 14, and 31. The visitor in each case had in hånd 
the statement of aims submitted by the instructor in the 
course. 

A grouping of the points mentioned in the comments on 
the visits and in certain retums from the questionnaires and 
from the other studies provides the headings listed below, 
each of which covers a part or aspect of the problem of 
college teaching, simply as teaching, although such headings 
also suggest, of course, problems of aim, of the organization 
of curricula, of administration, and of marking. The head- 
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ings are neither exhaustive nor mutually exclusive. The 
list is made up strictly from the data of this Inspection. 
Although the replies to the questionnaires are by agreement 
to be retained in confidence by the Division of Education, 
and the comments on the visits were also confidential, the 
summaries of the questionnaires, given in Chapter V may 
readily be compared with the list. Probably the list includes 
about all the chief factors in eflfective college instruction, 
and it includes many which are cleariy recognized and 
admirably used in some or all of the courses we visited; 
but it doubtless misses altogether many factors of critical 
importance in particular courses. In no single exercise, 
perhaps in no single course, can all the factors listed be f ully 
utilized. If the list and the discussion present adequately 
the various factors, each in its relation to the others, both 
those here considered and those that will occur to the 
readers of the report, this chapter will meet such expectations 
of its value as we could reasonably entertain. 

Note. A statement of our general impressions from the visits 
may be of interest, despite the faet that it can have only the value of 
a rough concensus of personal judgments. The reports show that the 
instruction in Economics, viewed as a whole, and so far as it went, 
impressed us as excellent. The lectures, with few exceptions, we fovmd 
clear, well-organized, stimulating, and forceful. Although in one or 
two instances they seemed to lack vitality and to win only a per- 
fvmctory attention from the students, in several cases they were as 
admirable for the power to arouse and hold the interest of the class, 
as for other good qualities. The sections we visited were noticeably 
less effective, in general, than the regular class meetings. In no case 
did the visitor consider the section work wholly vmsuccessful, but in 
some of the sections the youth and the personal qualities of the as- 
sistants made the meetings far less profitable than they should have 
been. 

It may also be worth while to mention here what seem to us to be 
the most promising directions for effort in the improvement of the 
vmdergraduate instruction given by the Department. These are: 
first, the abandonment, so far as may be possible, of sections, and in 
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courses where sections must be maintained, such measures as may be 
needed to secure assistants of greater maturity, fuller scholarship, 
and better training for their work; second, the adoption of methods 
for establishing doser contact between teachers and students (of 
which the Tutorial scheme now in operation is one) and especially for 
securing more frequent and more profitable reactions from the stu- 
dents, including fuller participation in class meetings; third, greater 
eflfort to devise and conduct with advantage, exerdses which will 
bring the students into active contact with the problems of the sub- 
ject, in their practical form. These proposals are discussed somewhat 
more fully below. 

II. A List of Factors in College Teaching, 
Especially m the Teaching of Economics 

A. Factors which afiFect the attitude of the student toward his 
work. 

(a) The stunulation of purpose in general and the definition 
of specific aims, by 

(i) Encouraging an imderstanding of the scope, object, 
and values of the course, by means of 

(a) Advice in the selection of the course 
(6) Printed statements about the course 

(c) Personal conference with students early in the 
course 

(d) Early discussion in dass of the character of 
the work required and of its values 

(2) Adapting the work, at least in part, to individual 
interests and needs, by means of 

(a) Permission to choose, within limits and under 
guidance, the subjects of theses, special read- 
ing, and other independent work 

(b) Personal conf erences with students 

(c) Discussion and criticism of tests and examina- 
tion books, in addition to the retiun of 
marks. 

(d) Personal guidance in thesis work, especially in 
the case of students imaccustomed to it 

(e) Provision for supplementary and voluntary 
reading or other work beyond the requirements 
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(3) Rdating the course to present problems of conduct 
or of thought, by means of 

(a) Discussion of these problems in class meetings, 
and frankness on the part of the instructor 
conceming his own point of view 

(6) Recognition of these problems in the choice of 
reading, thesis subjects, and other work 

{c) Lectures by persons other than the instructor 

{d) Credit in the course for participation in in- 
vestigations and other projects under govem- 
mental, philanthropic, or business auspices 

(e) Opportunity to use data from observation and 
investigation of activities, as in business and 
govemment, as well as from books 

(/) The use of current literature as material for 
class discussions, reports, etc. 

(b) The maintenance of attention and interest during class 
meetmgs, by 

(i) Securing appropriate attention in advance to the 
topics to be considered during class meetings, by 
means of 

(a) Assignments of special reading to be done in 
advance, and such tests or records of it as may 
be necessary 

(6) Formulation of specific problems and questions 
to be considered in connection with tie read- 
ing, or independently, and the requirement, at 
discretion, of written or oral reactions on them 

{c) Encouragement, or assignment as a task, of the 
discovery by students of particular problems 
vmder a general principle, or of new facts and 
applications involved; annovmcement in ad- 
vance of a date for discussion of these 

(2) Connecting class meetings definitely and explicitly 
with the other work of the course, by means of 

(a) Outlines and syllabi of the main divisions of the 
course, showing the connection of the lectures 
and class discussions with the general assigned 
reading and other independent work 

{b) Reports in class from individuals or groups on 
reading or investigation on the topic in hånd 
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(c) Use of required texts and other material in 
dass as the basis of discussions or lectures 

(d) Careful corrdation of the lectures and the sec- 
tion meetings 

(e) Discussion in dass of written papers and other 
assigned work 

(3) Making dear the purpose of eadi dass meeting 
and assuring a measure of progress toward it during 
the hour, by means of 

(a) Statements of purpose by the instructor and 
statements by students on question from the 
instructor 

(6) Outlines on the board or on sheets distributed 
to the class 

(c) Prevention of irrelevant discussion, question, 
and comment, and dismissal or postponement 
of problems not profitable to discuss — occa- 
sionally with assignments for reading or study 
to be done either by the dass or by individuals 
or groups 

(d) Sunmiaries of discussion, by the instructor or 
by the students 

(4) Providing appropriate opportimity during class 
hours for partidpation by the students, and mak- 
ing their partidpation profitable, by means of 

(a) Discussion, kept rdevant and stimulated by 
comment and question from the instructor 

(b) "Socratic" development of the topic by ques- 
tion and answer 

(c) Quizzes, oral or written; brief papers in 
class 

(d) Encouragement of questions from the dass 

(e) Records on the board of diverse opinions or 
points of view presented by students, and 
discussion or lecturing on the issue thus 
formulated 

(/) Extension of the discussion to the whole mem- 
bership of the class; direction of discussion to 
the class, not to the instructor 

(g) Encouragement for the presentation in das 
of instances, examples, applications, and prob 
lems discovered or formulated by the students 
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(s) Using skiUfully and advisedly the opportunities of 
the instnictor's position for persona! influence, by 
means of 

(a) Good lecturing, and skiUful leadership in dis- 
cussion 

(6) Frank expression of personal opinion and point 
of view on issues of importance in or connected 
with the subject of the course 

(c) Full and fair statement of contrary theories 
and points of view, in advance of criticism or 
comment 

{å) Cordial recognition of divergent opinion on 
the part of students 

{e) The use of concrete and familiar instances, ex- 
amples, and cases; the encouragement of stu- 
dents in discovery and citation of these 

ijf) Unsparing attention to the personal difficulties 
of individuals, outside of class meetings 

(g) Lectures by persons other than the instructor 

(c) The encouragement and direction of effort in study and 
in other work outside of class, by 

(i) Setting up reasonable standards of performance 
and maintaining them equitably, by means of 

(a) Careful calculation of the time required for 
reading, theses, and other work 

{b) Full statement of the requirements as to form 
in written work 

(c) Coordination of thesis requirements with 
those of other courses, and consultation with 
students and other instructors as to the 
best times for the submission of written 
work 

(d) Adequate directions for the use of sources, 
bibliographies, etc; care in arranging for prac- 
tical exercises; attention to library fadlities, 
laboratory arrangements, opportunities for 
fieldwork, etc, 

(e) Insistence on promptness in submitting work 
(/■) Personal conf erence with students in the course 

of their work 
(g) Frequent use of tests, quizzes, brief papers, 
etc, with explicit statements, of the way in 
which these are to '^count" in the final mark 
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(A) Specific references to reading, avoiding waste 
of time or neglect of work because of diflS- 
culty in discovering the application of assigned 
reading to the problem in hånd 

(2) Giving personal and adequate attention to the com- 
pleted work submitted by students, by means of 

(a) Full reading and personal comment in the case 
of theses and other written productions 

(6) Personal conf erences on the results of investiga- 
tions and other practical exerdses 

(c) Care in grading 

B. Factors which favor eflFectiveness of effort in the work itself. 

(a) The general organization of the course to prevent waste 
of time and distraction of eflfort, by 

(i) Coordinating the various requirements of the course, 
by me^ns of 

(a) Definite statements of the purposes in view, 
both for the course as a whole, and for sepa- 
rate assignments and exerdses ' 

(6) Outlines of topics for dass meetings, showing 
the connection between assigned reading and 
the lectures and discussions. (See A, (b), 
(2), (a), above) 

{c) Careful correlation of the lectures and the sec- 
tion meetings. (See A, (b), (2), (d), above) 

(2) Defining exactly the work to be done (see A, (c), 
(i), above), by means of 

(a) Printed statements in an outline or syllabus of 
the course 

(6) Adequate directions for the use of sources, 
bibliographies, etc; care in arranging for prac- 
tical exerdses; attention to library facilities, 
laboratory arrangements, opportimities for 
fieldwork, etc. (See A, (c), (i), {d), above) 

{c) The use of forms for return of information of a 
fixed character 

(3) Keeping dosdy in touch with the work of indi- 
vidual students, by means of 

(a) Reports on reading and other work 
(() Personal conf erences 
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(4) Managing tests, quizzes, brief papers, and examina- 
tions so as to show students their progress and help 
them to understand the subject, by means of 
(a) Care in choosing questions and topics 
{h) Discussion of the results in class and in con- 
ferences 

(b) The management of class and section meetings to favor 
eflfective leaming of various types, by 

(i) Assuring adequate and appropriate impressions 
when a set of figures, a graph, or other visual 
material is to be memorized, by means of 

(a) Distribution of printed sheets 

(6) Use of the blackboard 

{c) Use of colors, either on the board or on sheets 

{d) Use of the reflectoscope 

(e) Use of photographs 

(/) Insistance on accurate copying into notebooks 

of the material presented 
(^) Full explanation of the significance of the 

material 

(2) Assuring full assimilation of a definition, heading, 
quotation, or other exact statement to be memo- 
rized, either verbatim or in substance, by means of 

(a) Distribution of printed sheets 

{h) Use of the blackboard 

{c) Insistance on accurate copying in notebooks 

(å) Full exposition of the meaning 

(e) Discussion of cases, exceptions, opposites, etc. 

(/) Questions to test the students' grasp of the 
statement or their ability to apply it 

(3) Assuring complete understanding of a generaliza- 
tion, theory, point of view, interpretation, or other 
complex object of thought, by means of 

(a) Full exposition of the facts involved, prefer- 
ably before the generalization itself is presented 
— preceded or accompanied, if possible, by 
actual observation of facts and situations, in 
addition to or in place of presentation by lec- 
tures or reading 

(J) Careful definition of the problem which the 
facts present, pref erably by discussion — based 
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if possible, on paxtidpation in work which in- 
volves the problem in practical form 

(c) Encouragement of attempts on the part of 
students to make the generalization for them- 
selves; discussion of students' generalizations, 
either in class or in conf erences 

((/) Discussion of cases, exceptions, applications, 
etc; quizzeSy exerdses, practical assignments 

(4) Providing opportimities, incentives, and guidance 
for constructive thinking in class, by means of 

(a) Full statement of the facts to be considered — 
sometimes by the students, sometimes by the 
instructor; use of the blackboard to bring out 
clearly the facts or their significance 

(i) Definition of issues by discussion 

(c) Reports of reading or fieldwork, or statements 
of point of view by individuals and groups 

(d) Presentation of facts or convictions by "out- 
siders" 

(e) Discussion in class of theses, or of passages 
from texts 

(/) Discussion in dass of required oral or written 
statements or arguments on imsettled problems 

{g) Careful avoidance of dogmatism on the part 
of the instructor, without hesitation in ex- 
pressing his own point of view 

(A) The discussion of prindples in their actual ap- 
plication to cases and situations, either real or 
hypothetical 

(5) Using the lecture, discussion, quizz, redtation, 
and other modes of teaching with due regard to 
conditions, e. g., nimiber in the dass, their knowl- 
edge of the subject, etc, and to the character of 
the material to be considered, its difficulty, 
famiharity, the exactness with which it is to be 
recalled, etc. 

(6) Making the physical conditions of the dassroom as 
favorable as possible for attention 

(c) The direction of work outside of class to f avor eflfective 
eflfort, by 

(i) Encouraging good management in reading, thesis- 
work, etc, by means of 
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(a) Early and complete statement of requirements. 
(See A, (c), (i), (a) and (6), above) 

(6) Discussion of the character of the assignments 
and directions as to study and work. (See A, (c) 
(i), {d), above) 

{c) Personal conferences 

(i) Reports on reading, brief papers, outlines, 
quizzes, and other tests and reactions; discus- 
sion of these in dass and in conferences 

(e) Advice on review for examinations; the inspec- 
tion of notebooks; discussion of habits of study 
and the organization of materials 

(2) Using all opportunities to bring students into actual 
contact with the facts and problems of the subject, 
by means of 

(a) Requirement of personal observation to sup- 
plement reading. (See A, (a), (3), (c), above) 

(J) Participation in the work of govemmental, 
philanthropic, and other agendes and institu- 
tions. (See A, (a), (3), ((f), above) 

(c) Investigations and other "projects" of an 
active sort 

{å) Reports by students of instances, exceptions, 
and appUcations in contemporary lif e 

(3) Encouraging constructive work and direct personal 
formulation of problems, by means of 

(a) Permission to choose, within limits and under 
guidance, the subjects of theses, special read- 
ing, and other independent work. (See A, (a), 
(2), (a), above) 

(6) Personal conferences 

{c) Reports by individuals and groups in class. 
(See A, (b), (2), (6), above) 

(d) Encouragement of supplementary and volim- 
tary reading and other independent work 

(4) Avoiding assignments for work outside of class 
which involve leaming most eflfectivdy accom- 
plished under direction, by means of 

(a) Occasional use of dass time for presentation of 
material for exact memorization. (See B, (b), 
(i), above) 
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(b) Occasional use of class time for memorization 
of verbal statements. (See B, (b), (2), above) 

(s) Avoiding in class the presentation of material more 
economically studied outside of class, by means of 

(a) Use of printed sheets, docimients procurable 
by students, etc. 

(b) Assigument as a task of written analysis or 
application of prindples or problems not 
adapted to dass discussion or not sufficiently 
important or difficult to warrant it 

III. General Discussion 

Such a list as this requires no explanation, for it presents 
no suggestion difficult to imderstand, however difficult 
some may be to carry out; but it may well raise issues on 
which there is room for difiference of opinion. The whole 
first section of the list — "A. — Factors which affect the 
attitude of the student toward his work" — may seem to 
imply the notion that college instructors ought to court 
interest and cosset enthusiasm as if undergraduates were all 
spoUed children, mcapable of mdependent endeavor. The 
second section of the list — "B. — Factors which favor 
effectiveness of eflfort in the work itself " — may imply the 
notion that the student is to have his work so charted and 
guided for him that it will be all "plain sailing." Of course 
no such notions are intended, for the first section is meant 
merely to suggest ways in which the student's general will 
to work may be hamessed, directed, or given greater leverage 
or more specific application, and the second to suggest ways 
in which his eflfort may be made to yield the best results. 
The college student who has no interest in study and would 
rather shirk or himt "snap" courses than apply himself, 
presents a disciplinary problem, not a problem of method. . 
Method must be based on consideration of the normal case 
— the college student who has good intentions, who is 
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interested and ready to leam, who does the best he knows 
how. Toward him the college instructor has by no means 
discharged his whole obligation when he lectures as well as 
he can, assigns reading from the best treatises on the sub- 
ject, and provides a list of topics for theses. The methods 
of a primary school are hardly l^s appropriate in an Ameri- 
can college than the " laissez-f aire " methods of a German 
university. To stimulate purpose and define it, openly and 
without any attempt to interest the student "iTspL of 
himself," or to supply conditions and directions for his work 
which shall make it possible for him to get a good return for 
his time and energy, need not mean the sUghtest lowering of 
standards. Indeed such efiforts shoiild make in every way 
for higher standards. 

A suggestion very frequently advanced in the answers to 
the questionnaires, and consequently prominent m the list, 
is that more opportunity be provided for persona! contact 
between student and instructor. What students want and 
seem genuinely to need is not contact with assistants or 
younger instructors, but with the men actuaUy in charge 
of courses. The new system of Tutors will supply this need 
in part and for some men, but not as fuUy as would increased 
opportunity for conference with professors; and this need 
presents a problem by no means simple. It is easy to agree 
that conferences are profitable; but they are very time- 
consimiing. The problem is at bottom a problem of general 
college economy — the problem of the large course. The 
best solution, without question, is to have the whole work 
of a course done by one man; nothing can compensate to 
the student for the almost inevitable lack of unity between 
the professor and the assistant. It would seem an excellent 
investment of college fimds to permit professors in many 
cases to dispense with assistants and reduce the number 
of their courses. Ought not the work of a college instructor, 
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as a teacher, to be reckoned in any case by students rather 
than by courses ? And would it be impossible to arrive by 
discussion, without elaborate inquiry, at a reasonable 
measure of the teaching burden one man ought to carry?^ 

There are good reasons, of course, why certain courses 
should be kept too large for a single man to give. In some 
cases it might be f easible to have identical courses given by 
two instructors, but this would introduce certain diflSiculties 
due to imavoidable differences of abiUty and of point of view 
between the two. Where sections oflfer the best solution, 
as they undoubtedly do, for example, in Economics A, there 
seems to be no way of avoiding their disadvantages except 
by direct effort to secure the best possible assistants and 
to unify their work by the most careful management. The 
proposal that assistants receive some training for their work, 
mcludmg a practical apprenticeship under supervision, 
deserves careful consideration. The provision of eflfective 
training for prospective college teachers is surely not 
impossible and would be welcomed by many of them with 
genuine interest. 

Outlines and syllabi are mentioned as advantageous in 
several of the comments on the visits, and thus find appro- 
priate piaces in the list. Their advantages are perhaps 
less obvious than their dangers. In some courses, syllabi 
may be undesirable because of the character of the subject. 
It is possible, also, to invite laziness by providing a syllabus 
which has much the character of a set of printed notes, and 
hence tempts students to imdesirable "cramming." But 
a well devised syllabus will present topics rather than data 
and conclusions, and will serve rather as a map of the ground 
to be covered than as a means of getting over it without 

1 See Birge, E. A. " How Many Hours a Week Should be Required of Teachers 
in a University ? " Transactions and Proceedings of the National Association of 
Stak UniversitieSf v. 14, 1916. 
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effort. A syllabus may contain statements of the purposes 
of the course and directions for theses, field work, and 
exercises which wiU prevent misunderstandings and be of 
much value in gniding the students' eflforts; it should serve 
to iinify his impressions from the lectures and the reading; 
and by presenting specific assignments of reading in con- 
nection with each topic it may save time in class and in 
study. Its fimdamental advantage is that it makes it 
possible for everyone concemed, but especially for the 
student, to know at every point just where he is in the 
course, where he is going next, and why. 

One object of the questionnaires prominent in the mmds 
of the joint committee which framed them was to discover 
to what extent instruction in Economics is missing the needs 
of individual students. What the questionnaires reveal on 
this point is presented in another chapter; but it must be 
plain to anyone who has had experience in college teaching 
that one of our diflSculties as instructors — a difficulty not 
so pressing in any lower school — arises from the absence 
of continuous reaction from our students. We do not know 
what they are thinking about, whether or how they have 
grasped our meaning, what objections they might raise, 
what conclusions they are likely to come to. They have few 
opportunities for expression or for interchange of ideas with 
us or imder our guidance. This means educational waste in 
college classrooms; and this is the reason why participation 
in class exercises is so desirable, personal conferences often 
so illuminating, and the purely educational use of tests, 
quizzes, and written papers, with discussion of the results, 
so profitable. We frequently miss the individual simply 
because we do not know, psychologically speaking, where 
he is. When classes reach a certain size it is impossible to 
know individuals intimately at all, and the best we can do 
is to tempt revealing reactions on matters of importance; 
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but this disadvantage of the large class ought to be empha- 
sized on every possible occasion and we ought to coimteract 
it in whatever ways we can. 

Other sections of the Report present records to show 
that students do not give to their several courses anything 
like equal attention or eflfort. In part this is unavoidable 
and even desirable; but in part it is probably due to uneven- 
ness in requirements and to lack of calculation of the time 
reading ought to take, or theses, or practical exercises. 
College work is necessarily distracting in itself, and the 
student is further distracted by college activities even when 
he gives them only a reasonable amount of time and energy. 
It is surely important that our requirements be justly cal- 
culated, definitely set forth, and accompanied by directions 
so plain and ample that students need not waste time in 
whoUy valueless eflforts to find material which ought to be 
readily available. There is in this, of course, no disparage- 
ment of the value of an exercise involving the discovery by 
the student himself of new material or data adapted to his 
individual use but imfamiliar, it may be, even to the in- 
structor. 

In one respect college instruction seems to miss a fairly 
important opportunity to prevent waste of effort — it 
seldom dififerentiates clearly between the types of leaming 
required of students. College instruction easily becomes 
predominantly verbal — its conditions favor lecturing and 
assigned reading, make diflSicult the observation of facts 
and constructive reasoning from actual data, and tempt 
instructors to ignore the requirements of the simpler types 
of leaming, such as memorizing from sense impressions. 
Neglect to provide proper conditions for the memorization 
of visual material, or for verbatim leaming of definitions, 
is, however, easy to prevent. Leaming of either of these 
sorts may be conducted so that none but the la2y or def ective 
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can avoid a good result. But it is much liarder, as it is 
much more important, to bring students into actual contact 
with the facts and problems of a subject, outside of books. 

In the social sciences college instruction seems peculiariy 
prone to lack of reality. This is in no sense a charge against 
Harvard courses in particular, for there are notable instances 
of provision in Harvard courses for contact with "outside 
activities"; but it is evident that this provision might be 
systematized and extended. Yet it is evident, also, that 
advance in this direction is beset with difficulties. It is 
easy to bring students into contact with sources in literature, 
and not impossible in history; laboratories and specimens 
bring the object of study actually before the student in the 
natural sciences: but it is possible to give a course, for 
example, in Labor problems, without bringing the students 
into any contact whatever with laborers, the labor-market, 
the conditions of specific mdustries, or any other facts or 
situations with which the subject deals. It is not only 
possible to do so, but to attempt in such cases to bridge the 
gap between "study" and "life" may seem decidedly 
dangerous. For in Economics, students can sometimes be 
given at best only a gUmpse of the facts, and their impres- 
sions may be very misleading and imscientific. A proper 
variety of facts may, furthermore, be quite out of reach. 
There is a strong tendency therefore to avoid disaster by 
sticking to lectures, reading, and the study of documents. 

But if college instruction is really to induce men to think, 
lack of reality is a fatal defect in it. The most educative 
thing a man can do is to observe facts for himself , define 
an issue from them, argue it out with his fellows, and apply 
his conclusions in action or in further thinking. The process 
of finding a problem in the facts, and solving it, awakens 
interest and Ulimiinates the subject; to be successful in it 
breeds confidence and suggests new lines of inquiry; the 
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conclusions thus reached become vital and permanent posses- 
sions and afifect conduct directly and forcefully. The most 
pressing need in the method of college teaching in the 
social Sciences is therefore the need of devising "projects," 
"practical" exercises, and means of contact with the facts, 
* institutions, conditions, and situations which the various 
courses treat. This need seems already to be recognized as 
imperative, as the appointment of Committees on Practical 
Training by the American Economic Association and the 
American Political Science Association and of a Committee 
on Field Work by the Association of Urban Universities 
would indicate;^ but committee inquiries are less productive 
and more Hkely to be led astray by visionary leadership 
than is quiet experiment in the courses of a single depart- 
ment. 

Practical training means in the present discussion simply 
a method of teaching, and may be used as such in a course 
which aims at an entirely "cultural" result, as, for example, 
a general imderstanding of the field of Economics as a whole. 
In a course which aims directly at preparation for vocational 
or other social activity, practical training would naturally 
be intensified and made continuous. The place and import- 
ance of such courses is discussed above, in the chapter on 
Aims. 

Practical training may of course be overdone, and field- 
work developed as a method without discrimination. De- 
vices and even so-called principles may become for the 
teacher as confining as tradition and a blindly accepted 
procedure. The only end in itself in education, as President 
Lowell has recently emphasized, is the student — but, it 
may be added, the student seen always in relation to the 
society into which his education is to fit him as a member. 

^ See also The Public Servante a journal published by the Sodety for the 
Promotion of Training for Public Service, Madison, Wis. 
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The only secret in teaching is the secret of keeping dearly 
before one's mind the object to be attained and adapting 
one's procedure to it; but the object is complex and the 
adaptation of necessity varied and often delicate. The 
Division of Education may well disclaim any ability to 
point out to the Department of Economics a new or better 
road to success than the road it is already f ollowing — the 
road of careful analysis of the problems of teaching and of 
continued attention to the details of teaching, as its chief 
duty with imdergraduate students. 



CHAPTER VII 

MARKING 

I. A Study or A Set or Marks Given m 

ECONOMICS A 

Through the courtesy of Professors Taussig and Day a 
study of marking in Economics A was camed out during 
the spring of 1913. 

Ten mid-year books were selected and marked, after the 
usual carefxil discussion of standards, by seven instructors 
in the course. In each book there were ten answers, and 
each instructor gave a separate mark for each answer, as 
well as a mark for the book as a whole. The mark for the 
book was of course an aggregate of the ten marks for the 
answers. The resulting series of marks (seven himdred in 
all) was examined from several points of view, with the 
following results. 

The study considered two main problems, namely, (i) 
what questions of the ten making up the books caused the 
greatest diversity in marking, and why? (2) how greatly 
did the instructors vary in their estimates of the books 
and questions, and inddentally, which instructors varied 
most from the central tendency? 

Problem I 

Which of the ten questions caused the greatest diversity of 

judgmentj and why? 

Sheet A (p. 199) contains in detail two samples of the 

data which provided the numerical basis for a solution of 

X06 
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this problem. In the case of each question we listed in the 
first column (headed Av.) the arithmetical mean of all the 
grades given to that question in each of the ten books. The 
figures given in the colimms headed A-G state the devia- 
tion of each marker from the average presented in the first 
colimm. The last colimm gives the average of these devia- 
tions for the separate books, and the bottom line the average 
deviations for the several markers. By taking the arith- 
metical mean of all the deviations on each question, it is 
evident that we could secure in one figure an index to the 
variation caused by that question. 

Sheet B (p. 200) shows the questions arranged in order of 
this figure. It will be seen that Question 4 caused the least 
diversity and Question 3 caused the greatest diversity. 
In Question 4 the average diversity was less than one grade 
on a scale of ten; on Question 3, nearly a grade and a half. 
On a percentage scale, the diversity on Question 3, Book 
VIII (the book which caused the greatest diversity on that 
particular question) averaged 17 per cent; one marker gave 
the answer zero, another seventy; and only two markers 
gave it the same grade. On Question 4, Book II, all the 
markers agree : this is the only instance of perf eet agreement 
in the one himdred sets of marks. 

The questions were : 

1. Give examples of each of the foUowing: vertical combination; 
intemaleconomies; localizationof industry; increasing retums. 

2. In the case of a commodity produced under constant retums, 
does demand determine the price of the commodity or the 
quantity produced? Illustrate by diagram. 

Would your answer be the same if the commodity were pro- 
duced under diminishing retums? 

3. The cost of raisiQg wheat on new land in Canada is said to be 
far below the average cost of raising wheat in the United 
States. Supposing this to be the case, can wheat grown in the 
United States continue to be sold in foreign countries in com- 
petition with Canadian wheat? 
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4. How would a great increase in the world's supply of gold 
affect: (i) The value of the gold dollar. (2) The value of the 
Silver dollar. (3) The price of silver bullion. (4) The price 
of gold bullion. 

5. State briefly what was the course of prices in the United States 
(a) between 1860 and 1870, {b) between 1900 and 1910. What 
were the causes of the price changes in each period; what evils 
arose; and how could the evils have been avoided? 

6. Arrange the following items of a bank statement in their proper 
order: 

Loans $380,000 

Bonds 50,000 

Notes 50,000 

Capital 100,000 

Other Assets 40,000 

Suiplus 30,000 

Undivided Profits 10,000 

Real Estate 22,000 

Deposits 350,000 

Due from banks 10,000 

Notes of other banks 3i00o 

Cash 35»ooo 

Could this be the statement of a national bank, conducting 
its business in conformity to law? 

Suppose the bank to sell bonds which on this statement are 
carried as worth $50,000; selling them at a profit of $1,000, 
and recdving cash for them. Rearrange the statement, and 
consider whether it could then be the statement of a national 
bank conducting its business in conformity to law. 

7. How would a great increase in the production of gold in the 
United States affect: 

The imports and exports of the United States; 
The "balance of Tråde" of the United States; 
The price of foreign exchange in New York? 

8. Suppose large remittances to be made by immigrants from the 
United States to their native countries: what consequences 
would you expect on (i) the stock of specie drculating in the 
United States; (2) the relation between merchandise exports 
and imports; (3) the gain which the people of the United States 
secure from foreign tråde? 
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9. Which of the foUowing would you reckon as part of the wealth 
of the country? as part of its capital? 
The Great Lakes, 
The Panama Canal, 
Deposits in banks. 

10. Is the establishment of a manufacturing industry, brought 
into existence by a protective tariff, advantageous in that it 
creates a home market for agricultural products? 

SHEET A 

Problem I. Also Problem n, Section i 

The relation of the questions to one another in respect to the degree of varia- 
bility which they cause in the marks assigned to them 
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Chart I (below) presents the facts under the first problem 
in graphic form. A glance will show that the markers ara 
in fairly close agreement on Question 4, whereas on Question 
3 they spread out horizontally on ahnost every book. 

This Chart suggests also at least one reason for diversity 
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Question 4 — in the case, namely, of Book IV. FoUowing 
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the student who wrote this Book was generally a poor 
student: his grades fall low on most of the questions. We 
discover also that on almost every question he caused much 
variation in marking. Furthermore, the Chart shows a 
great preponderance, in general, of agreement in the marks 
that fall in the higher half of the scale, as against agreement 
in the marks that fall in the lower half. Four or more 
markers agree forty-five times in giving grades 6-10 inclusive, 
only seven times in giving grades 0-5 inclusive, and three 
• of these instances are on grade 5. From tables such as 
those given on Sheet A we may secure a statement of this 
tendency in a single figure — the coefficient of correlation 
between the average grades on all the questions in all the 
books and the corresponding average deviations of the 
markers. This figure is: r = -.401, which shows that as 
the marks descend, disagreement tends to increase. 

To the layman it is easier to see from the form of the 
questions themselves why Questions 4 and 6 should cause 
least diversity than it is to see why Questions 10 and 3 should 
cause greatest diversity; but it is the answers rather than 
the questions which must yield any further explanation of 
variation from question to question, and for such explanation 
as they may yield the whole conduct of the course must be 
taken into accoimt. No doubt the instructors varied from 
one another in different degrees on different questions 
largely because they had different bases in experience for 
estimating what might justly be expected of any student 
on any question. 

Problem II 

Haw do the markers vary ? 

I. The tables used in Problem I offered some help in the 
solution of this second problem. 

In these tables we had each instructor's deviation from 
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the average mark on each question in each book — loo de- 
viations for each instructor. The average of these deviations 
ofifered us an index of each instructor's tendency to vary 
from the central tendency of the group. By this index the 
instructors ranked as f oUows : 
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Instructor 


A.D 
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.83 


2 
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.89 
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.91 
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.93 
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.93 
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•99 
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1.14 



On the average, Instructor D varied from the central 
tendency less than one grade on a scale of ten, Instructor A 
varied considerably more than one grade. Instructor D 
agrees with the average seven times, Instructor A, four. 
Instructors E, B, and A each vary once by as much as four 
grades in a scale of ten. 

This index of variability does not show us, however, the 
actual variety of deviation in the case of any instructor — 
it faUs, that is, to show for any instructor how erratic he 
was in his marking or whether he varied from the average 
by marking higher or lower. The extent and frequency 
(but not the direction) of each instructor's deviations could 
be seen, of course, by foUowing his colimm through all the 
tables. 

Some indication of these facts may also be obtained from 
Chart I, but it would be difficult to foUow the symbol of 
any given instructor through the several distributions. 

Chart II (below) gives us in a graphic simamary further 
evidence on one of these points, viz., the tendency of any 
instructor to mark consistently "high" or "low," or to 
range his marks in any peculiar fashion along the scale. 
This Chart represents the distribution of all the marks 
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(100) given by each instructor, without reference to the 
question or book for which any were given. It shows, 
therefore, only a tendency to give more 4's and 5 's, or more 
9's and lo's than the group as a whole — i. e., variability 
in range of grades but not in the placing of them. Thus 
this Chart shows that A tended to mark higher than the 
average, since he most often gave the mark 10, but it does 
not show whether his lo's fell with the other lo's or were 
given to quite different questions or to the same question in 
different books. 

2. A graph to show at what points, how far, and in which 
direction each instructor deviated from the central tendency 
in each of his 100 markings would necessitate a very com- 
pUcated figure; hence for graphic representation of variabiUty 
it seemed best to tum to the marks given to each book as 
a whole. These marks, of course, being aggregates, hide 
certain variations: agreement on the book may not 
indicate agreement on a single question; but variation on a 
book is a certain indication of variation on one or more 
questions and might be followed back to the fuller data 
given in the tables. 

The character of the variation among the markers is 
shown in several ways. (a) Sheet C shows the variation 
in the ranking of the books on the basis of the marks given 
them by the several instructors. There is full agreement 
as to the worst book — Book IV. There is practical agree- 
ment as to the ninth book, and considerable as to the eighth. 
Thereafter there is little agreement except as to the book 
for first place. Book X, on which six markers agree, the 
remaining marker putting it second. Yet for second place 
six different books are chosen. It is plain that variation 
in judgment is not inconsiderable, in spite of careful effort 
to avoid it. (b) Sheet D shows the extent of variation in 
the actual grades given to the several books. In one case 
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S&EET D— -Problem II, Section 2 

The extent of variation among the marks given to each book, with graphic scheme 

to show instructors' rankings 
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(Book I) this is as much as 28 grades. The least variation 
on any book is 12 grades (Book VI); this would make a 
difference eqnivalent to a full grade on the regular Harvard 
letter-schedule of grading. Such a difference might mean 
the difference between passing and f ailnre, or between honors 
and a mere pass. Under certain circumstances it might 
determine a man's fate for the A.B., or for the degree with 
distinction. 

This sheet gives us an opportxmity, also, to foUow a 
given instructor's markings through the series of books and 
to discover to what extent any given marker is an extremist, 
or erratic. Thns A is seen at once to be extreme in his 
gradings and a high marker: on ffve books he gave the 
highest grade, on two books he gave next to the highest, on 
one next to the lowest. B is almost as extreme as A, but 
at the other extremity. D is remarkably consistent in his 
close agreement with the median mark^ on each book. 
(c) Sheet E shows the position of each instructor in relation 
to the median mark on each book. The median is shown by 
the black line; to follow the deviations of a given instructor 
find his letter imder each book. This Sheet repeats the 
data of Sheet D in another form. (d) Chart III gives the 
graph of the median marks on each of the 10 books, from 
the highest down, and compares this with the graphs of 
the several instructors' marks for aU the books in the same 
order. By this Chart an instructor may readily foUow 
his own deviations, (e) Sheet F shows the extent to which 
each marker tends to deviate from the central judgment 
for each book. 
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SHEET E 
Problem n, SEcnoN 2 

Variability of Instmctors 

The marks assigned by each instructor to each of the ten books, shown in rela- 
tion to the median mark for each book 
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The Interquartile Range is taken as a zone of sound judg- 
ment. The distance (on the scale of grades) by which any 
instructor's mark on any book falls outside this zone can 
be then seen. Thus on Book I, B's mark is 9 points outside 
the Interquartile Range, G's mark 3 points outside. The 
sxun of these distances for each instructor, shown on Sheet 
G (p. 210), presents in a single figure his tendency to differ 
from the group. This figure gives a ranking of the instruc- 
tors as to variability on the whole series of books, which may 
be compared with their ranking as to variability on the 
questions (see above). The following table is a rearrange- 
ment of the results obtained from Sheet G. 

Outside of the Interquartile Range 

Rank Marker Number of Times Points Above Below 

1 D I I — I 

2 C 3 i8%a 3 S%3 

3 G 6 I aH loH 

4 F s SH 17H — 

5 E s 207H — 20H 

6 B 6 27H — 27H 

7 A 8 51H 503^ I 

Totals i4i%3 75H 66H3 

(f) Sheet G and the table just given show roughly the 
relation between variability in grading and the tendency 
to grade higher or lower than the group. The two most 
variable markers are sharply contrasted, A varying 50 points 
above the group to i below it, B varying altogether below. 
There is a similar contrast between F and E. G and C, who 
are not extreme in either direction, tend to vary further 
downward than upward, and if we omit the extreme case 
fxirnished by A, this is the tendency of the group as a whole. 
This suggests the conclusion that a severe judgment tended 
to lead to greater divergence than a lenient judgment; i. e., 
that the mood of condemnation made for inaccuracy, or 
possibly, that having decided against an answer the instruc- 
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tors saw less need for care in rating it. Chart I confirms this 
suggestion. In 38 of the 100 squares on the chart there is 
indicated an agreement of at least three markers and a 
divergence of at least one marker by as much as 3 points, as 
for example, in the sqnare giving the marks on Question 3, 
Book III. Studying these divergences as the extreme cases 

SHEET G 

Problem n, SEcnoN 2 

Divergences outside the Inteiquartile Range 
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Plus (+) indicates diveigence abave the Interquartile Range. 
Minus (— ) indicates diveigence belaw the Interquartile Range. 

which call for some explanation, we find that 29 of them are 
divergences downward, 17 divergences upward. There are 
six divergences of 4 points downward, three of 4 points 
upward; two of 5 points downward, one of 5 points upward. 
The total variation downward from these selected modes is 
97 points, the total upward 56 points. Divergence down- 
ward evidently tended to be greater than divergence upward. 
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The nximber of books was too few to permit any general 
answer to the question, "Does a poor book cause greater 
variation than a good one?" From what has been shown 
as to poor answers and as to severe judgments, it may be 
inferred that it does. 



II. CONCLUSIONS FROM THE SXUDY OF MaRKS GiVEN IN 

ECONOMICS A 

The conclusions of faet from this study may be stated as 
follows: 

1. There was much diversity of marking, both on ques- 
tions and on books, in spite of effort to avoid it. 

2. Some markers showed a persistent tendency to mark 
either high or low; others were erratic; some varied very 
little from the central tendency. 

3. The variation on books was sufficient to be of grave 
consequence to the student. 

4. Poor answers caused greater diversity than good ones. 

5. Severe judgments tended to cause greater divergence 
than lenient ones. 

In so far as these conclusions hold for college marking in 
general, they may fairly be said to make clear two of its 
main requirements : first, that instructors use every means 
to reach clear agreement on standards and to steady their 
judgments in applying them; second, that they grade with 
special care answers which seem to them inadequate. 

In the general discussion which follows, the practical 
problems which these statements suggest are considered at 
some length. It is obvious that no interpretation of the 
conclusions would be safe without a broader basis of faet, 
if this study were xmsupported by others of similar character. 
But the problem of marking has been studied extensively 
enough (as the references given below make evident) to 
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render it unnecessary to gather f urther data in this particular 
instance, although other studies would unquestionably be 
worth while. It gæs without saying that there is no inten- 
tion to imply the slightest lack of eflfort to attain accuracy 
of marking in Economics A or to suggest that the saf eguards 
discussed are either unknown to, or neglected by, the 
instructors in that course. This chapter of the Report is 
written in the belief that a general treatment of the problem 
of marking in college courses, based on the data presented 
above, may be of interest, and possibly of profit. 

III. General Discussion 

An economist, Professor F. Y. Edgworth, published in 
the Journal of the Royal Statistical Society, in September, 
1888, one of the first thorough treatments of variation in the 
marking of examinations. There is a certain poetic justice 
in beginning this discussion by a citation from his paper. 
The statement to be cited sums up, in a sense, his "human" 
conclusions, and presents at once the central problem in 
college marking. It is to the eflfect that there are some 
honor men who "like the xmsimg brave 'who lived before 
Agamemnon,' . . . are huddled unknown amongst the 
ignominious throng, for want, not of talent, or leaming, or 
industry, or judgment, but of luck." 

This is the root of the evil in the marking system — that 
marks are so much a matter of chance. Professor Edgworth 
proves that all marks — even those on large aggregates — 
are as likely as not to be three per cent out of the way. 
Any mark, even xmder generally favorable conditions of 
marking, may deviate from the "true" mark by nine per 
cent. That is, there is a probable error of three per cent, a 
possible error of nine, in assigning a mark as representative 
of the student's real proficiency. These errors are reckoned 
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"from the supposed ideal mean which would be presented 
if a large number of competent sets of critics were to examine 
the work." The difiference between two examiners is likely 
to be much greater; a given examiner may vary very widely 
from another who might have been in charge. (Many recent 
studies, like the one here reported, confirm this conclusion.^) 
Out students are not wholly imjustified, therefore, in looking 
on the attainment of academic credit as a game, a gamble, 
in which merit coimts only roughly, fortime being the real 
arbiter at critical points. 

To the student who has had bad luck, there is small 
comf ort in the advice that next time he make so much greater 
effort as to raise himself beyond the possibility of dis- 
advantage from even a nine per cent error. Perhaps he has 
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already done the best he can. Nor is it much more comf ort- 
ing to assure him that " he is playing a game in which superior 
skill must make itself felt in the long nm/' His failure to get 
a "C" or a "B" may put him out of the game; or his sense 
that the game is one of chance may tempt him to try it 
again without much effort to improve his skill, in the hope 
that next time his luck will nm the other way. It is natural 
to assign to merit whatever one has achieved, to fortime 
whatever one lacks of achieving what he thinks he merited. 
Although the incertitude of marks is not the only cause, 
nor always the chief cause, of that xmwholesome attitude 
toward study which is so of ten noted and deplored, it is 
xmquestionably one of the causes, and one for which the 
student himself cannot be held to blame. 

Not that instructors are to blame, if they make an honest 
effort to mark jxistly. Safeguards against error have yet to 
be more fully developed and tested for general use, before 
anyone can be accxised of neglect because his marking is 
somewhat at fault. The error of three per cent calculated 
by Edgworth is an error to which an uncorrected mark is 
inevitably liable, considering the frailty of hxmaan nature 
and the imperfection of the data on which marks are given. 
Disagreement among instructors is natural. Increased 
divergence in the lower part of the scale is also natural, 
since an inadequate answer gives us f ewer data on which to 
base conclusions. But there is no escape from the duty of 
discovering and testing all the available methods of render- 
ing marks more accurate. 

For marking cannot be avoided, nor can the importance 
of accuracy in marking be denied. Every mark we assign is 
important, as an item in an aggregate which, for the student, 
determines success or failure. Even a low mark, on a poor 
answer, ought to be assigned with care. The question is, 
what safeguards against inaccuracy all along the line — 
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from the mark on a single examination answer to the mark in 
a course — are worth trying? 

Efforts to avoid inaccuracy may be divided into three 
classes, not imrelated nor exhaustive of the possibilities, 
but worth distinguishing: (i) eflforts to simplify the data on 
which judgments are to be passed; (2) efforts to avoid error 
in the judgments themselves; (3) efforts to correct error 
in the final retums. The opportimities now apparently 
open imder each of these heads will be discussed in order. 

1. Efforts to simplify our data. The prospect of securing 
standard tests in college subjects is very remote. Accom- 
plishment in a college subject is a product so complex that 
no series of simple or xmiform reactions can adequately 
represent it. We cannot avoid variation by securing data 
which wiU permit ahnost mechanical grading, as we can in 
the case of elementary arithmetic; nor by using a fixed 
series of questions to which "standard" answers might be 
given. Our data, consequently, will always ,call for the 
exercise of judgment. 

If it were at all possible, in such a course as Economics A, 
to work out a series of problems calling for definite and 
easily graded reactions, which might be used as a fair 
measure of accomplishment, it would of course be well 
worth while to make the attempt. If a test could be devised 
such as to give reasonable assurance that 100 per cent in 
passing it meant actual achievement of a high order, that 
50 per cent meant half that achievement, and that error 
in assigning the grade could rarely occur, we should have 
an ideal instrmnent of measure. To fulfill these require- 
ments, the test would have to consist of problems to which 
numerical or very simple and definite verbal answers could 
be given; yet it would have to be comprehensive, and every 
problem would have to be so constructed that mere guess- 
work or the application of simple common sense could not 
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result in a correct solution. Obviously there is not much 
chance of securing more than a few sets of problems even 
approximating these specifications. If they were used as 
examinations, it would take a professional tutor a very short 
time to drill his clients into an easy "mastery" of the course. 
All that it is possible to recommend is that examination 
questions be so constructed as to favor definiteness and 
simplicity in the answers as often as may be; but it may be 
added that a test of the kind described (or anything like it) 
might be very useful and informing as a supplement to 
examinations or as a means of research. 

Examinations do not give us, to be sure, the only data 
on which our marks are based; but our estimates of worth 
in other cases (theses, exercises, laboratory and field work) 
are not less subject to error, but more. There is a fertile 
topic for exact and painstaking investigation in the question, 
How much should examinations coimt in the final mark, 
and how much any other sort of evidence of accomplish- 
ment? Other things equal, any piece of work which is to 
be marked ought to be presented in a form as favorable as 
possible to accurate estimate of the accomplishment it 
represents. But it is clear that we cannot mechanize the 
work we ask students to do, merely in order ^to enable us 
to mark it justly. A piece of work of the greatest value to 
a student may be the hårdest to mark; yet students pay most 
attention to work on which they are to receive grades, and 
the incentives which grading offers cannot be neglected. It 
must be admitted that the eflfort to simplify data for the 
sake of avoiding error in marking is not so important as the 
eflfort to secure data which shall signify the f ull character of 
the accomplishment we wish to rate. 

On this score it would seem worth while to distmguish at 
least four kinds of data: (i) answers to pure "memory 
questions"; (2) the solution of test problems set by the 
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instructor; (3) free expression on topics chosen by the 
instructor or the student; (4) constructive treatment of 
complex practical, scientific, or literary problems. Examina- 
tions give us for the most part data of the first two kinds; 
essays, theses, laboratory exercises, and fieldwork, of the 
last two. In most college courses, we need data of all these 
dasses in order to test accomplishment; but power can best 
be evidenced by data of the last three. It would seem 
advisable to devise as many "projects" as we can in con- 
nection with any course (that is, practical exercises involving 
the independent collection, handlmg, and interpreting of 
facts in the field the course covers) ; and such work ought to 
be given much weight in the final mark: yet it is not easy 
to grade. As we develop a larger nxmaber and variety of 
practical exercises to take the place of a part of the present 
lecture-text-book-test routine, we shall be increasing rather 
than diminishmg the inherent diflSculty of accurate grading. 

2. Efforts to avoid error. There is the greater need, there- 
fore, of effort to steady and correct our judgments. K we 
could look forward to the development in college subjects 
of scales, analytical scorecards, or other objective standards, 
such as are already used to good effect in handwriting, speU- 
ing, and certain other subjects of the elementary school, 
we might be content to do as well as we can without other 
aids xmtil that royal road should be opened. But any such 
expectation must be very narrowly limited. The variety 
and complexity of work which is really to exhibit the power 
achieved in most college courses puts an objective standard 
of grading out of the question. We must fall back on means 
of rendering subjective standards more reliable. 

To this end nothing can obviate the necessity of care and 
of honesty of purpose, nor diminish the value of experience. 
If a young instmcto; is working alone, there arTnot, of 
course, many opportimities for him to improve his judg- 
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menty except by reflection on his own performance, which 
is always worth while. (For purposes of comparison a col- 
lection of theses, reports, and examination books illxistrating 
the varioxis grades would probably be useful — an inf ormal 
objective scale, which might profitably be discussed, in 
certain cases, with the students in the course.) In large 
courses, however, where several instructors mark the same 
or similar work, conferences on standards, the multiple 
reading of doubtful books, and the discussion of selected 
books and answers are available as means of acquiring 
steadiness of judgment, although such eflforts cannot of 
themselves guarantee agreement. It ought to be possible, 
also, to make the marks on the first tests in the course show 
the tendency of each instructor, so that he may take waming 
and accommodate himself to the majority judgment, as safer 
than his own. (Probably the mode is in many cases the 
safest standard to take for this purpose, since it represents 
an actual agreement. A mode discovered on a second mark- 
ing, after full discussion, could be accepted as almost 
objective in its validity.) College instructors in general 
ought in all probability to spend more time and eflfort in 
the attempt to make their marking accurate; and several 
"sessions" early in the year, spent on the serious study of 
retums in test cases, might save much time later on — to 
say nothing of the contribution they might make to the 
achievement of the real aim in view. 

In anticipation of difficulties in the marking of examina- 
tions, no single safeguard is more useful than fuU analysis 
of the desired answers. What each answer is to contain or 
attest ought to be known in advance, and the proposed 
value of the answer in the whole book, and of each element 
in the answer, caref uUy considered and discussed. The larger 
the niunber of elements to be taken into account, the smaller 
will the error of judgment on the aggregate be likely to be. 
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The advantages of questions as tests of accompKshinent 
must be balanced against possible disadvantages due to 
probable difficulty in the marking of the answers. In general, 
it may be said that the making of examinations is quite as 
difficult and important as the marking of them. 

The assignment of values to questions is in itself a special 
problem. Professor Inglis ^ suggests that values ought to be 
equated on the basis of actual performance by the students. 
A question that proves in faet twice as difficult as another 
question ought not to have the same weight in the total; 
and on the groxmd that we cannot indict a whole class of 
laziness, inattention, or dullness, it would seem that the 
"hard" questions ought to coimt less than "easy" ones. 
This would mean, of course, a general raising of examination 
grades; but not necessarily the passing of more students 
nor the granting of more honor grades, since these matters 
may be otherwise controlled. 

3. Efforts to correct error. Af ter every practicable effort 
has been made to render judgments accurate, it may still 
be supposed that the final grades are subject to error. There 
remains the possibility of correction according to a theoreti- 
caUy determined standard. An ideal grouping may be 
constructed to which the actual grouping shall be made to 
conform, and this procedure can be justified on the groxmd 
that it will result in a rating more accurate than that pro- 
vided by any given series of marks. The standard provided 
by the Probability Curve can be accepted only as a starting 
point or remote backgroxmd; what is needed is a standard 
derived from a sufficiently large nimiber of marks by a 
sufficiently large number of competent critics, assigned to 
students of the same general type in the given subject. In 
default of such a standard it would seem dangerous to make 

* Inglis, A. J., "Variability of Judgments in Equating Values in Grading/' 
Educational Administration and Supervisian, Januaiy, 1916. 
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drastic general use even o£ a skewed curve determined on 
pxirely theoretical grounds. A theoretically determined 
curve may take account of the selective influence of progress 
through school to college and may thus be available for use 
m large general courses, but it cannot be appHed to marks 
in a section nor in a small or advanced course. Even a curve 
derived from several general courses does not necessarily 
fit the probable distribution of ability in a group electing 
a particular subject; nor can the acciunulation of marks 
over a series of years be subject to criticism if it does not 
conform to such a distribution, \mless it can be shown that 
no systematic selective influence has been continuously at 
work on the group in question. A good standard distribution 
for a particular course might be foxmd in the whole series of 
marks in other subjects obtained by men electing that 
course; and such dLtributions might weU be made at 
intervals for all the larger college courses.^ 

If a given course ought by reason of its subject or aim to 
be easier (or harder) than an average college course, some 
adjustment in the standard would have to be made; also, a 
distribution derived from marks in other courses in the same 
field might in some cases seem more useful than one derived 
from courses in other fieids. 

The disadvantage of any such standard is that it ignores, 
or rather directly coxmteracts, the effect of good teaching. If 
we aim at a certain minimmn accomplishment for every 
member of a course, it is a confession of failure to admit 
that any predetermined percentage of our students cannot 
possibly reach it. Our business is to correct the chance 
distribution of ability among them by laboring mightily with 
those who could not succeed xmaided. A student aroused to 
interest by good teaching may justly complain if, after 

^ Edgworth, in the artide referred to, p. 634, gives a method for correcting an 
actual series of marks by the use of a standard or ideal distribution. 
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doing his best under sympathetic direction, he is f ailed on the 
ground that a certain number of men in the course ought 
theoretically to receive E's. In the last analysis the issue 
is between the instructor's estimate of accomplishment as 
it is evidenced by examinations and other data, and the 
theoretically probable accomplishment of the students he 
deals with. How much shall the deviation of his grouping 
from the normal grouping cause him to distrust his own 
judgment? The distortion of a series of marks honestly and 
carefully given cannot be recommended as a good policy; 
yet continuous divergence from a standard distribution 
properly determined would argue either marvelous and 
improbable efl&ciency in teaching or an xmusual and equally 
improbable selection of able students — supposing the diver- 
gence to be upwards on the scale. (A divergence downward 
would be more disturbing to the instructor as to his teaching 
and the ability of the students electing his work, more 
comforting to him as to his standards.) If neither of these 
conditions is likely (as neither usually will be), the only 
conclusion the instructor can come to is that his standard 
of accomplishment is xmduly low (or high). He ought 
therefore to reexamine his standard, and make his course 
more (or less) exacting. 

It is fair, then, to say that standard distributions are 
proper instnunents for the use of instructors in the whole- 
some process of critical examination of their own work, and 
that their eflfect ought to be apparent in the general level- 
ing of requirements in courses; but that they ought not to 
be applied indiscriminately to the correction of every set of 
marks. 

This conclusion stands in direct contrast to the con- 
clusion reached in several recent studies of college marking 
— namely, that students should be rankede not marked, 
with the corollary that the distribution of ranks should 
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conform to the normal distribution. The general procedure 
advocated is that the best performance should be given the 
highest grade and the other performances rated in order 
below it; if the distribution thus produced is not normal, it 
should then be corrected by reference to the standard 
curve. The advantage claimed for this method is that it 
avoids the inaccuracy arising from the attempt to rate a 
student's accomplishment by referring it to a supposed 
objective standard which does not in faet exist. We believe, 
however, that greater injustice and confusion will result 
from this method than from careful efifort to estimate each 
individual's accomplishment in terms of a standard made 
as objective as possible (or defined as clearly as possible) 
by discussion, analysis of results, and comparison of grades. 
To give any student a mark which indicates only that he 
stood last, or twentieth, or first, in a class of one himdred is 
neither just nor informing. The student (and everyone 
else) inevitably takes the mark to indicate achievement in 
the subject. Unless we define how well the himdred did, it 
means nothing to say that A was first or last; and to give 
A the grade which means failure, merely because he was 
last, may work gross injustice. Vague as our standards 
may be, there is more promise of success in the efifort to 
define them and apply them with care, than there is m the 
proposal that we ignore them. 

In accepting a relative standard there is, moreover, a 
subtler danger still. To be assured that an "A" invariably 
means that a student is among the highest two or three 
per cent in his group provides, in one sense, to be sure, an 
exact meaning for the mark — but it tells us nothing about 
the actual level of achievement in the group as a whole 
and may lead us theref ore to accept as a definite estimate of 
proficiency a mark the meaning of which varies in reality 
with every instructor and every class. And when an 



MARKING 223 

instructor knows that his marks will be considered "satis- 
factory" if they are distributed in the "normal" propor- 
tions, he may well be tempted to give up all reference to 
an "abstract" standard of achievement and hence to be 
content with whatever proficiency his instruction produces. 
Reference to an "objective" standard is salutary to student 
and instructor alike. There is no safety in marking except 
through the effort to define a standard and to mark as 
justly as may be in terms of it. The "normal distribution" 
serves best as a basis of criticism for the standard an in- 
structor has actually in mind. 

There is one possible precaution against error which our 
Harvard marking system does not favor — namely, the 
building up of the final grade from a large number of items. 
An aggregate is much less liable to error than a single 
item : hence a final grade reckoned from a number of grades 
for single points (papers, exercises, examination questions) 
is more likely to be just than a grade assigned at a broad 
guess. But computation of grades means the use of numeri- 
cal values, and we use an official scale of letters not defined 
m numerical terms. This raises the general question of the 
most advantageous number of gradations in the marking 
scale. There can be no doubt that the percentage scale 
contains too many gradations for effective use: indeed, 
teachers f ail to use more than the main points on the scale, 
as the clustering of their marks aroimd the natural modes 
(the fives and tens) bears witness. But a scale with ten 
gradations is apparently quite usable; and such a scale may 
be expressed in numbers. Using a scale of ten we may 
construct a final mark which represents an aggregate of 
single impressions rather than a single (and very general) 
impression; and when this aggregate covers a considerable 
number of items the chances of error are much reduced. 

Against this procedure it may be urged that the grouping 
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of students into five main classes (A's, B's, etc), with due 
regard to the conf ormity of our grouping to the ideal group- 
ing, is more likely to avoid error than is any other method. 
It is true that broad distinctions are easier to make; and final 
rating in terms of such distinctions is therefore desirable. 
But in the doubtful and border-line cases ("high C" men, 
"low C" men, et al.) we are thrown back on some method 
of checking up our estimates. Our distribution may con- 
form in general to the ideal grouping, but who shall tell 
whether we have dealt justly with the individuals thus 
grouped? 

Accuracy in marking of ten demands the combination of 
separate items, the computation of an aggregate from 
weighted parts, and other calculations; and this demand 
cannot be fulfilled if we use only relative ranks expressed 
by letters. 

In the end it must be recognized that there is no short 
cut to justice in marking. Care and efiFort are essential 
everywhere. Fimdamental in the whole business is the 
necessity of organization in the work of the course itself : 
the fitting of requirements to the limitations of the student's 
time and to his stage of advancement ; the most advantageous 
balance in the assignment of reading, conferences, papers, 
practical exercises, and other work; the best arrangements 
for guidance and the greatest expUcitness of instructions 
without loss of initiative to the student. Our courses need 
a measure of administrative standardization, which need 
not mean in any sense mechanization. Definiteness as to 
the demands which a college course may reasonably make 
on a student's time and effort is the best basis for every 
attempt toward accuracy in the grading of his work. 



CHAPTER VIII 
Summary of Conclusions and Recommendations 

This chapter brings together in a series of brief statements 
the more important conclusions and reconmiendations of the 
Report. These have been arranged by groups in the order 
of their general importance; that is, the conclusions and 
reconmiendations we consider fimdamental have been pre- 
sented first and in a separate group, other findmgs and sug- 
gestions, even though they may be of more immediate prac- 
tical interest, being grouped thereafter imder spedal heads. 
These statements are all subject to the qualification men- 
tioned on page 6; and we summarize them here not in order 
to insist on each in tum, but in order to bring them into rela- 
tion to each other and to promote convenience of reference. 
It seemed desirable thus to present the major results of the 
Inspection in a grouping indicative of oxir own interpretation 
of their relative significance. The numbers in parenthesis 
refer to pages on which the various conclusions and recom- 
mendations are stated or discussed, or on which facts in 
support of them are given. Evidence and argument from 
scattered portions of the Report are thus combined to show 
what seems to us their logicai bearing. 

I. Conclusions and Recommendations of General 

Importance 

A . Concerning the Study and Regtdatian of Instrtiction 

Undergraduate teaching should be subject to fuller de- 

partmental discussion and supervision (lo, 13, 17, 18, 174, 

995 
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178, 190). The problems of teaching shoxild be given more 
direct and objective study (4, 9, 10, 15, 88, 95, 96, loi, 178, 
190). The normal amoimt of teaching shonld be reckoned 
more exactly and the importance of teaching be given fuller 
recognition (10, 14, 15, 88, 190). 

B. Concerning the Aims and Organization of Courses 

The aims of conrses should be more clearly defined (17, 25, 
171, 173, 174) and students made more fully aware of them 
(i 50, 1 70) . The predominantly practical purposes of a large 
majority of the students (28, 113, 115, 147, 148, 149) should 
be recognized in the organization of curricula (10, 13, 21, 22, 

26, 31, 32, 33, 34, 135, 159, 160, 174). 

C. Concerning the Effectiveness of Instruction 

Instruction should be more closely adapted to the piuposes 
and needs of the students (10, 12, 13, 87, 151, 152, 161, 162, 
166, 176, 177, 189, 192, 197, 211, 224). Personal contact 
between professors and students should be more frequent 
(14, 114, 116, 136, 152, 162, 164, 180, 189, 190). Fuller 
guidance in the choice of courses (116, 150, 174) and in meth- 
ods of study (13, 14, 87, 165, 192) is desirable. Occasions for 
participation in class and for reaction on lectures and reading 
should be more frequent (114, 162, 180, 191). Teaching 
should have fuller reference to contemporary aflFairs and the 
work of students should provide more frequent occasion for 
direct and personal contact with them (10, 26, 83, 115, 116, 
139, 140, 151, 161, 162, 166, 173, 180, 194). 

II. CONCLUSIONS AND ReCOMMENDATIONS ON SpECIAL 

Topics 

A. Concerning the Relation of Economics to Other Subjects 

The relations between ranking in Economics courses and 
ranking in courses in any other subject do not justify 
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special recommendations (35, 39, 56). As compared with 
the "t3T)ical" Harvard correlation coefficient of 50 per cent, 
the correlations of Economics A with Mathematics C and 
with (Jovemment i are fairly high; other correlations of 
Economics A are low (52, 57, 58, 59). (Jovemment i seems 
to have the closest relation to Economics A and Government 
in general to Economics (35, 37, 58, 150). Interpretations 
of correlation coefficients shonld be made with caution (55, 
56, 64, 65, 66) ; but correlations between Economics marks 
and admission marks support the belief that admission ex- 
aminations are poor tests of ability (60, 67, 70). 

B. Concerning the Relations of Economics Courses to Each 

Other 

Standing in Economics A does not materially aflFect the 
election of advanced instruction in Economics (44, 45); 
and although men of high rank in Economics A are much 
more likely to go on to strictly graduate work (44, 46, 50), 
men of low rank may do well in middle-group courses 
(50). There are marked differences in the abilities of the 
groups electing the several advanced courses (50, 51, 57); 
and in the grading of advanced students there is some arbi- 
trary and avoidable shifting of marks (49, 50, 63). 

C. Concerning Marking 

Neither the standard distribution of marks for the De- 
partment (40) nor the "Probability Curve*' (42, 219 ff.) 
can be taken as a final basis of critidsm for course distri- 
butions (40, 42, 57). An agreement (mode) is a better basis 
than an average or median (40, 218). Standards at mid-years 
and at finals should be the same (41). College marking is at 
best far too much a matter of chance (197, 202, 203, 206, 
213) and every care is needed to make it accurate. (215 ff.) 
Poor answers in examination books are hårdest to grade, and 
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severe judgments most likdy to be erratic (200, 201, 209, 
210). The ranking of students and the assignment of grades 
in fixed proportions according to a standard distribution is 
to be condemned. (219 ff.) 

D. Conceming Details of Instruction 

There is great dissatisfaction with assistants and with 
sections; sections should be given up wherever possible 
(115, 136^ 161, 162, 164, 179, 190). Class discussion as a 
method is favored by a number of graduates (114), and 
greater care in the assignment, coordination, and facil- 
itation of reading is desired (151, 152, 161, 162, 166). 
Memory work is not imduly stressed (106), but devices 
for sharpening interest could well be multiplied (92, 93, 94, 
106). Graduates, advanced students, and students of high 
standing profit most from lectures; other students get more 
from other phases of their work (114, 154, 157). 

E. Concerning the Students 

The puiposes of the students are primarily practical, 
either vocational or social (149, 159, 160), and curricula 
should be framed to meet their need of practical training 
(31-34). They choose courses largely on their reputation 
(150, 174) and are but little able to distinguish the specific 
values of the instruction they receive (150, 159, 170). In 
their study they have in mind primarily the requirements 
of courses (87) ; and they need guidance in methods of work 
(87, 88); but they are interested in many contemporary 
problems (160). Yoimg students are at no disadvantage in 
Economics courses (71). 
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I. A List of Problems for Investigation 

I. The student body. 

I. Preparation. 

(a) Are students admitted to any course too young to 
profit by the work? 
Study age and rank corrdations in Economics i 
and perhaps other courses. 
Ought the department to restrict admission to 
its courses by age or dass? 

(6) Are students who have taken History or Civics in 
high school or History or Government in college 
at any advantage over other students in Eco- 
nomics A? 
Study rank in Economics A of students who 
have passed in advanced admission History, 
Economics, or Government; also rank of those 
who have had History I, Government I, or both 
in college. Use test questions in Economics A. 
Ought the Department to require any prep- 
aration courses for Economics A? 

(c) What requirement of courses in Economics, His- 
tory, or Government, or other subjects should be 
made of students admitted to advanced Eco- 
nomic courses? 

Study ranks, give tests in class, inspect students' 

lecture notes, teachers' syllabi. 
What sequences of courses ought the Depart- 
ment to insist on? 

(d) What is the initial equipment of students in the 
Department? in knowledge of economic data 
and problems? in power to deal with economic 
questions? 

Test questions in Economics A. 

Ought the Department to have a standard 

test of this sort? What suggestions for the 

elementary course does it yidd? 
999 
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2. Conditions of study. 

(a) Are thesis work, reading, and fiddwork economi- 
cally distributed? 
Study inddence of assignments — amoiints of 
reading to be done, theses, etc. in individual 
cases. 
Ought the Department to make more careful 
rules as to assignments? What is the normal 
amoimt of reading and thesis work for an 
imdergraduate course? 

3. Personal aims. 

(a) Are students sdecting Economics courses intelli- 
gently and purposefully? 

Questionnaire as to personal aims, and the value 
of instruction in subserving them. 
What data as to personal aims ought in- 
structors to have and what accoimt ought 
they to take of such data? What advice as 
to selection of courses is needed? How should 
courses be advertised? 

(b) Are students attempting to secure the degree with 
distinction with full imderstanding of its value? 

Questionnaire — statistics as to numbers tak- 

ing degree, failures, etc. 
Should any changes in the conditions, an- 
noimcements, or management of the degree 
be made? 

(c) Is concentration in the Department intelligent 
and purposeful? 

Questionnaire — statistics — facts conceming 
advice given, conferences with instructors, etc. 
Ought the Department to guide more care- 
fully students who concentrate? 

(d) Is candidacy for the Ph.D imdertaken with ade- 
quate information conceming the values of the 
degree and of the work for it, and with dear aims? 

Study of careers of former candidates — ques- 
tionnaire — study of thesis subjects — statistics. 
Ought the Department to differentiate its 
work for the Doctorate or dissuade any from 
attempting it? 
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4. Social demands. 

(a) Does the instruction in the Department meet the 
needs of graduates for economic information and 
insight? 
Questionnaire to graduates and business men 
in general, economists, and officials. Test ques- 
tions to students, espedally to students who 
have taken only Economics A and are now in 
Senior Year or in a Graduate School. 
What practical needs ought instruction, es- 
pecially in Economics A, to meet? 

S- Capadty and achievement. 

(a) What are the factors in the problem presented by 
the D and E men? 
Study individual cases to determine causes of 
failure and poor work. 
Ought the Department to keep more careful 
and more readily available records of stu- 
dents' work and regulate admission to courses 
in the light of such records? 

(6) What can be done to make more eflFective the work 
of high-grade men? 
Questionnaire as to aims of A and B men and 
the relations of their work in Economics and in 
other Departments. 
Ought the Department to imdertake more 
careful guidance of the work done by high- 
grade men? 

n. The instruction. 

1. Aims. 

(a) Are the aims of the coiirses and groups of courses 
adequately defined? 
Study pamphlet, talk with instructors and stu- 
dents, consult economists. 
Ought the Department to define the aims of 
its work more clearly or on a new basis? 
How should it advertise the work? 

2. Scope. 

(a) What portions of the economic field are not cov- 
ered by the instruction, if any? 
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Co5peration of economists. Study of instruc- 
tion offered in other universities. 
Ought the Department to expand its work? 

(b) Does the instruction provide adequate training in 
the more important methods of economic investi- 
gation and economic thought? 
Cooperation of economists. Study of other 
universities. Inquiry of instructors. 
Ought the Department to cover Economic 
Methods in a separate course, or otherwise? 

3. Organization. 

(a) Is the work so distributed that it meets best the 
needs of the students? 

Study enrolhnent in courses. Question stu- 
dents and instructors. CoSperation of eco- 
nomists, business men, govemment officials. 

Ought the Department to strengthen certain 

fieids? 

(b) Is the work so organized that there is a minimum 
of duplication of eflFort? 

Study students' and instructors' lecture notes 
— terminology — topics. 

Ought the Department to agree upon terms 
and the treatment of topics? 

(c) Is the work organized so as to bring the students 
and instructors into touch with the economic 
forces and agendes in the outside world? 

Study plans of work in courses, conferences, 
etc, and non-instructional activities of the De- 
partment. Cooperation with economists. Other 
universities. 
Ought the Department to plan for more defi- 
nite contact with the economic world? 

(d) Is the work so organized as to enable students to 
acquire insight in the fidd as a whole and power 
in special fieids? 

Study correlation of courses, actual curricula, 
fidds of theses for degrees with distinction, Ph.D. 
candidates, etc. 

Ought the Department to open new possi- 
. bilities of spedalization, and new opportunity 

for coordination of courses in groups? 
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{e) Is the work so organized as to make f uU use of the 
students' related work? 

Study correlation of coiirses in History, Gov- 
ernment, Social Ethics, Education, Anthropol- 
ogy, as to hours, periods of history, etc. 
Ought the Department to plan more directly 
for correlation? 

(/) Is the work so organized as to minimize the dis- 

advantages of large courses? 

Study the work of conference and section as- 

sistants. What are the variations of method, 

marking, hours, and results among sections? 

Question students and instructors. Apply tests. 

Ought the Department to divide large courses 

into smaller courses or use administration 

measures for further control and improve- 

ment of the work done in large courses? ' 

4. Administration. 

(a) Is there an adequate system of administrative 
control of instruction? 
Study the provisions for administrative con- 
trol by consultation with members of the De- 
partment. Study the plan of administration in 
other universities. 
Ought the Department to devise a more com- 
plete system of administrative control and 
assign the work to members relieved from 
instruction for that purpose? 

(6) Is the marking system eflFectively used? 

Tests to determine subjective variations of 
standard. Curves of marks in coiurses to deter- 
mine range of marking. Questionnaire as to 
aims in the use of marks. 
Ought the members of the Department to 
agree more definitely as to bases for marking 
and the use of marks? 

{c) Are examinations in the several coiurses effec- 
tivdy used? 
Study the examuiation questions: Do they test 
the student's knowledge? Do they permit in- 
structors to grade students on examinations 
justly? 
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Ought the Department to agree upon methods 
of examination and the use of examinations 
as tests and as educative exerdses? Is there 
a possibility of agreeing upon the weight ex- 
ammations ought to have in the make-up of 
the final mark for a course? 

(d) Is it possible to devise and apply a standard 
measure of progress in capadty to handle eco- 
nomic data and solve economic problems? 
Get the cooperation of the instructors of the 
Department and of economists outside the 
university in devising a series of test questions 
which can be applied from year to year to show 
progress in general grasp of economics. 
Ought the Department to test students who 
concentrate in economics and determine in a 
general way the progress they are making 
from year to year? 
5. Method. 

(a) Is inductive presentation possible and fruitful in 
particular courses? 
Experiment with inductive and deductive pres- 
entation. 
Ought instructors to resort as often as possi- 
ble to inductive procedure? 

(6) Is it possible to teach economics through the ac- 
tivity of the students themselves in gathering eco- 
nomic data, attempting economic generalizations, 
and facing economic problems? To what extent 
can actual economic investigation be used as a 
means of instruction, in the place of reading and 
abstract discussion? 
Experiment with student activity as a means of 
instruction. 
Ought the Department to organize more op- 
portunities for laboratory and field work? 

(c) Is the leaming of economic facts and prindples 
properly conducted and adequately tested by 
instructors? 
What are the kinds of data instructors think 
necessary to be leamed? Is there any attempt 
to guide the students in the memorizing of this 
material? Are tests and discussions suffidently 
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frequent to give ample opportunity for recall 
and application of the material? 
Ought the instructors to make a doser study 
of the presentation of those parts of theu- 
material which they expect students to retain 
exactly m mind? 
III. Thestaff. 

1. Size. 

(a) Is the staff adequate for the work to be done? Is 
the work properiy distributed? 
Personal data from instructors. Inquiries among 
students conæming value of conferences with 
assistants. 
Ought the Department to try to secure more 
men, or more men of a given rank? 

2. Selection. 

(a) What is the method of nomination of new mem- 
bers of the staflF and what are the recognized re- 
quirements for appointment? Is there any differ- 
entiation of requirements for different kinds of 
work, such as emphasis on teaching power for 
work in Economics A? 
Inquiry and general discussion. 
Ought the Department to adopt a more 
clearly defined policy in the selection of 
teachers? 

3. Organization. 

(a) Is the organization of the staff suffidently defi- 
nite, so that responsibility for the achievement of 
specific aims rests dearly on individuals? 
Inquiry among members of the staff and general 
discussion. 
Ought the Department to group courses for 
more definitdy educational purposes, and 
divide responsibility for the accomplishment 
of them? 

4. Diverting interests. 

(a) What outside work do members of the staff un- 
dertake and what relations do such tasks bear to 
the work of instruction? 
Personal inquiry among members of the staff. 
Ought the Department to define more dearly 
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the duties which may properly be under- 
taken as professional activity by members of 
the stafiF and arrange instruction accordingly? 

IV. Equipment and resources. 

(a) What does instruction in Economics cost, as a 
whole, and by courses, both absolutely and in 
comparison with other subjects? Is the cost 
reasonable, considering the r^ults? 

II. Theses m College Courses 

The writing of theses in college conrses — how many 
are required, of what length, at what times, of what value 
to the student, under what standards of content and of 
form — may be pictured in some detail from the replies to a 
questioimaire sent to Seniors in Jime, 19 14, by the Commit- 
tee on the improvement of students' English. This study was 
made by a member of the Division of Education serving on 
the Committee and is here for the first time reported in full. 

The questioimaire read as follows: 

In accordance with the request of the Board of Overseers, a Com- 
mittee has been appointed to suggest methods of unproving the qual- 
ity of English written by students in college. The Conunittee will 
be greatly obliged to you if you will fill out this blank and mail it at 
once in enclosed envdope. Please do this with as much accuracy as 
possible, and withotU dday. 

CHARLES H. GRANDGENT, CAafrnwii. 

Datewhen 

student was in- 

f ormed of thesis 

Length requirement Date when 

Sttbjectof (inwoffds and thesis waa 

Course Thesb approximateiy) subject handed ia 

1. Name of student: 

2. Theses written in 
1913-14. 

3. Other larger pieces 
of written work 
(not including 
those in courses 
in English Com- 
position) 
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4. How far were yoxir theses (and other like tasks) marshalled con- 
veniently, how far did they come due at dates inconveniently near 
each other? 

5. Were you notified that the English used, the style and arrangement, 
were of unportance? 

6. How much attention did you actually pay to these matters? 

7. Remarks and suggestions: 

Four hundred and twenty-two blanks were sent out and 
ninety-four replies received. The foUowing table shows 
the number of theses and "other larger pieces" written 
during 1913-14 by the ninety-four students who replied. 
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Some students evidently suffer from a "congestion" of 
thesis requirements — not so many as to make this dis- 
advantage an excuse for general laxity in students' English, 
but enough to make it apparent that instructors should use 
care in assignments. 

The following table shows the " thesis-economy " of these 
students from another angle. It presents what may be 
cailed the " total- word-burden " of thesis writers during an 
academic year. 



Students writing in all not more than 5000 words 

" " " " between 5000 and 10,000 words 

lOyOoo i5|000 
" i5iOOO " 20,000 " 
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tt 



tt tt 



17 

17 
II 

II 
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Students writing in all between 30,000 and 25,000 words — 6 

— 3 

— 2 

— o 

— I 

— 3 

— 2 

— 21 
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tt 

t€ 



25,000 

30/xx> 

35,000 
40,000 

ASfioo 



30,000 
35,000 
40,000 

SOfioo 



SOfioo or more words 
Students writing no theses 



A f ew students evidently have to write fax too much in the 
conrse of a college year — not so many, again, as to 
account for generally poor English in the College, but 
enough to make clear the need of care in managing 
assignments. 

The average length of theses, in words, is 8079; of "other 
large pieces," 3626. 

The f ollowing table shows how the theses were marshalled 
throughout the year — that is, it shows how many students 
were writing at a certain rate in any given month: e. g., in 
March, five students were writing at the rate of 20,000 to 
40,000 words. 

Number of students writing at various rates (in hundreds oi words) in the 

several months of the Academic Year 
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March . . 
April . . 
May . . 
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Some students are plainly " rushed " in their thesis work. 
The testimony of the replies shows that 54 men found their 
theses conveniently marshalled and 17 foimd them incon- 
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veniently marshalled. Twenty-three gave no testimony on 
this point. 

The average length of time for the preparation of a thesis 
was two and three-fif ths months — a fair period for a thesis 
of reasonable length, if the materials are available without 
prolonged search and if they are not unduly difficult to 
assemble and present. 

Thirty-f OUT men were notified that " the English used, the 
style and arrangement, were of importance"; forty-nine were 
not so notified; eleven made no answer on this point. 
Twenty-eight paid considerable attention to English; forty- 
six paid little attention to it; six none. Twelve made no 
statement conceming their efifort to write well and two 
answers were doubtful. Neither instructors nor students 
pay enough attention to the English used in theses. 

Special mention of theses in Economics courses occurs 
in some replies and is implied in others. The trend of this 
testimony may best be seen from the following quotations: 

Paper No. i. Economics courses in which theses were 
written: 4a, 6a, 2b, 4b. 

"In the Economic conrses I paid very little attention to English, 
mostly because I did not have time and it was not required, and 
secondly, because I fdt that my instructor did not know much 
more English than I did. This is not in praise of myself , but more 
a criticism of the instructor. If there had been more room on the 
paper I could have told you more. I feel very strongly against the 
present young instructor at Harvard. Of course they get the best 
for the money that is given for that piupose, but I have seen too 
many that do not understand young men and are very hard to 
approach.'' 

Paper No. 5. Economics courses, etc. : 4a, b4. 

''The whole S3rstem of assigning work seems rather slipshod. 
When work is arranged conveniently it is rather by chance than by 
any S3rstematic plan." 
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Paper No. 6. Economics conrses : 4a. 

^'My only suggestion would be to announce the subject of the 
thesis at the b^ginning of the year and let the student who has 
more than one choose his own time for doing it before mid-year; 
also put a slight requirement on good English.'' 

Paper No. 15. Economics courses: 43,^ 9, 33. 

^'No particular emphasis was placed on these qualities, although 
all insisted upon bibliographies, and in some cases, critical bibliog- 
raphies." 

''Although theses are very valuable in most courses, I think 
there can be too much of a good thing. Life for me this year has 
been one thesis af ter another — ' with a little profanity thrown in.' '' 

Paper No. 23. Economics courses : 4a. 

"If advice in conferences on theses was not limited to scope 
and sources but induded also a detailed consideration of arrange- 
ment of material, a gain in deamess, if nothing else, would result.^' 

Paper No. 25. Economics courses: 4a, 4b. 

"Reports such as those in Economics 4a and 4b have to contain 
many statistics and are not well adapted to literary style." 

Paper No. 27. Economics courses: 33. 

"Only in the Economics 33, for distinction, was much atten- 
tion to such given." 

"Conceming pure research, in many courses, too much em- 
phasis should not be placed on the English and style, for the stu- 
dent may have but a poor store at his command, and yet prepare 
a valuable work." 



III. Age and Scholarship 

The general relation between age, scholarship, and 
academic discipline is shown by the foUowing quotations 
and charts from an article in the Harvard Graduates' 
Magazine for Jirne, 19 13. 

The facts which are used in this study were gathered from the 
college records of 5769 students — all the "r^ular" Freshmen en- 
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tering in the classes from 1902 to 1912 indusive — that is, all the 
students in these classes except those who entered as "special" stu- 
dents, or as "undassified" students, or as students admitted from 
other colleges. Each record was dassified, according to the student's 
age at entrance, to show whether he had been (i) admonished, (2) on 
probation once, (3) on probation more than once, (4) visited with 
severer discipline (such as suspension), or (5) expelled permanently. 
The cases of students who left "for other than disciplinary reasons" 
were separatdy recorded. Also, the cases of students who achieved 
the degree cum laude or better, were separately recorded. The rest 
were dassified (with no disparagement to their daims for distinction 
on other groimds) as students "of no record." The dassification was 
in faet much more complicated than this, distinguishing discipline 
"for low rank" and "for conduct" and dividing the records in other 
ways; but for present purposes the groupings just named are most 
significant. 

The summarized results of this labor are simple and striking. Of 
the total number of students entering at each age from 15 to 22, they 
show what proportion got into "trouble" of any sort with the Col- 
lege Office, what proportion achieved at least the lowest form of 
regular academic commendation at Commencement, and what pro- 
portion escaped both discipline and distinction. The three curves 
plotted on the following chart present these facts in graphic form. 

The points in these curves indicate, of course, percentages. Thus, 
of the total number who entered at 18, 39.40 per cent were at least 
admonished by the College Office, whidi is shown by a point on the 
black curve of "wickedness"; 40.69 per cent were "of no record," 
which is shown by a point on the dotted curve of "inoflfensiveness"; 
and 19.80 per cent graduated cum laude or better, which is shown by 
a point on the broken curve of scholarship. 

Af ter accuracy in compilation, the importance of statistics depends 
on the number of cases recorded. Because the group that entered 
at 15 shows the highest percentage of scholarship and the lowest per- 
centage of "wickedness" we can by no means safely condude that 
fif teen-year-old bo3rs would be the best population we could get for a 
Freshman dormitory. There are only 19 cases in the whole group. 
The sixteen-year-old boy group is larger, but still too small for safe 
condusions — 218 cases. The groups entering at 20 and over are 
also small. But the groups recorded between the two heavy vertical 
lines — the seventeen, eighteen, and nineteen-year-old groups — are 
all large and not too widely disproportionate: 1102 cases at 17, 1981 
cases at 18, 1394 cases at 19. These numbers are great enough to 
give us a fair basis for argument. The continuous rise in the "wick- 
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edness" curve, and tiie amtinuous drop in the schdarahip curve, 
carrying across the lines for these three big groups, show a real ten- 
dency, on which we may rely. 

This tendency is dearly in favor of youth. Tke coUegt gets btUer 
aeeragt results, uiith less fricHon, from younger men than from older 
men. Possibly this faet may be shown more clearly by a chart of 
columns representing actual numbers than by a chajt of curves rep- 
See Chart n. 
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Here the three groups of columns represent together all the stu- 
dents admitted at the ages really in question — 17, 18, and 19. Thé 
numbers for these ages do not vary so markedly as to Mde the true 
proportions of the columns in each group — tiie black column for 
college "sinners," the white column for college "commim folks," the 
shaded column for college "saints." If Dean Hurlbut and Mr. Cram 
could meet (say in the Yard at the opening f& the year) thtee grm^ 
of entering students prophetically divided as these columns indJcate, 
there would be small doubt as to which group they would welcome 
most heartily to Harvard College. 
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Now it may seem that in all this there is too much "lumping" of 
results. "Trouble" means anything, from admomtion — a simple 
waming from the guardian of college morals — to complete dis- 
inheritance by a mortally offended Alma Maler. This might obscure 
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such diSeraices in the tendencies of "youth" and "age" to give con- 
cem to the Administrative Board as would really vitiate conclusirais 
about the relative burden of transgression among young men and old. 
Ferhaps among oLder students "a word to the wise is sufficient," 
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whereas among younger ones hot heads cannot be restxained with 
wamings. As a faet, the exact opposite is the case. Chart III shows 
"wickedness" analyzed into its several categories. The proportion 
of students of a given entrance-age who finally reach any cirde of this 
Inferno can be f ound by noting the point where each curve crosses the 
line for that age. 

The significant thing about this chart is the point, marked by an 
appropriate star, at which falls the largest percentage of students re- 
ceiving each particular kind of college censure. Among the younger 
students the proportion content with the milder college pimishments 
is large; as we go up the ages the severer penalties daim a greater share. 
Quite a diflferent result would not have been surprising. 

Scholarship, analyzed, shows an analogous result. The younger 
men have an advantage over the older, except that the oldest — those 
who entered at 22 and over — show some superiority when compared 
with those who entered a year or two earlier. The curve for the magna 
cum laude men is slightly irregular; but the chart as a whole shows the 
same relation of age to the several grades of scholarships as is indicated 
by the curve for the "lumped" result, in Chart I. It is not espedally 
surprising, of course, that the younger men, up to a certain age, are 
better students, on the average, than their older classmates. But it is 
worth noting that the superiority of the younger men persists, through 
the three important ages, for every grade of scholarship. See Chart IV. 



IV. ACCOUNTS AND ACKNOWLEDGMENTS 

The expenses of the Inspection were paid in large part 
out of a gift from Mr. Joseph Lee, of the Visiting Committee 
for the Division of Education, to whom we wish to express 
our appreciation of this evidence, among many, of his 
interest in the work of the Division. The preparation of 
the Report was paid for from the funds of the Department 
of Economics; and in part out of general fimds of the 
Division of Education and a gift to the Division from Dr. 
Alfred Johnson. The total cost of the Inspection was 
$1383.77. The expense of printing the Report has been met 
from a generous gift from Mr. Felix Warburg of New York, 
a member of the Visiting Committee, to whom we wish also 
to express our sincere thanks for this and other benefactions. 



SUPPLEMENTS 245 



V. A List of Documents and Materials Used in 

COURSE OF THE INSPECTION 

1. Pamphlets of the Division of History, Government, and Eco- 

nomics, 1912-13, 1913-14, iQU-iS* iQ^S-i^^- 

2. Report of the Committee appointed by the Department of 
Economics to consider Courses of Instruction. 

3. Votes passed by the Department of Economics conceming 
courses. 

4. Outline of a Plan for a General Final Examination in the 
Division of History, Government, and Economics. 

5. Division Examinations for the Degree of A.B., 1915-16. 

6. Schedule of courses in approved specific fieids of concentra- 
tion within the Department of Economics. 

7. Letter from Professor Bullock, March 7, 1913, conceming 
guidance given to students by members of the Department. 

8. Letter from Professor Bullock, November 10, 1914, concem- 
ing coordination of courses in the Department. 

9. Report of Mr. John Wells Morss of the Visiting Committee 
for the Department conceming section meetings in Economics A. 

10. Statement by the Committees on Practical Training appointed 
by the American Political Science Association and The American 
Economic Association. 

11. Preliminary Report of the Committee on Practical Training, 
American Political Science Association, Proceedings 19 13-14. 

12. Questionnaire on Field Work issued by the American Associa- 
tion of Urban Universities. 

13. Article on Sequence of Courses in Economics at the University 
of Chicago, Journal of Political Economy, Vol. XXI, No. i, Leon C. 
Marshall. 

14. Article on the College of Commerce and Administration of the 
University of Chicago, Journal of Political Economy, Vol. XXI, No. 2, 
Leon C. Marshall. 

15. Survey Smnmary, University of Wisconsin Survey. 

16. Comment of the University Conmiittee on the Survey Sum- 
mary. 

17. Miami University Bulletin, Series XI, No. 10. 

18. Bulletin of the Massachusetts Institute of Technology, Vol. 
46, No. 2. 

19. ]E^fficiency Measurement in College, Harvard Alumni Bulletin, 
Vol. XVI, No. 8, President Lowell. 
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20. College Studies and Professional Training, Educational Remew^ 
Vol. 42, No. 3, President Lowell. 

21. Tests of College Effidency, Report of a Spedal Conunittee of 
the Oberlin College Faculty, 1908^. 

22. Academic and Industrial Effidency, Bulletin No. 5, The Car- 
negie Foundation for the Advancement of Teadiing, 1910. 

23. Sdiool and University Grades, Bulletin of the University of 
Wisconsin, No. 368, Walter F. Dearbom. 

24. The Relative Standing of Pupils in the High Sdiools and in 
the University, Bulletin of the University of Wisconsin, No. 312, 
Walter F. Dearbom. 

25. Sdentific Grading of College Students, University of Pitts- 
burgh Bulletin, Vol. 8, No. 21, Raymond W. Sies. 

26. Sdentific vs. Personal Distribution of College Credits, Popular 
Science MotUUy, April, 1911, President William T. Foster. 
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